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SYNOPSIS 

ETHIRAJAN GOVINDA RAJAN 
Ph.D 

Department of Electrical Engineering 
Indian Institute of Technology - Kar^sur - India 

September, 1983 

STUDY OF SICNALS AND SYSTEMS IN THF FRAMEWORK OF 
MARKOV'S CONSTRUCTIVE MATHEMATICAL LOGIC 

This thesis is concerned with the problem of formulating within the framework 
of Markov's constructive mathematical logic, certain structural concepts of a 
theory for signals and systems defined over monoids of finite alphabets. Markov's 
normal algorithms play a dominant role in this theory. 

The central idea on which the work reported in this thesis is based is that of 
treating a signal space as a free monoid of an alphabet, and a system as a normal 
algorithm over the alphabet. 

With signals treated as words from a specific alphabet A, our first step is 
to consider the realization of various signal processing operations in terms of 
string manipulating normal algorithms. The signal space in this context is a subset 
of the free monoid, A , of A (i.e., the monoid consisting of all possible finite 
words from the alphabet A, together with the associative binary operation of 
concatenation of words). 

A normal algorithm Jf over a given alphabet A is in essence a mapping that 
recognizes a subset X of words in A and maps it onto another subset Y of words 
in A*. With the subsets X and Y treated respectively as input and output signal 
spaces, our next step is to examine on the lines of the theory of formal languages. 
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the signal processing normal algorithms as rewriting systems described by a 
grammar and then as automata. 

The third step in our work is concerned with the formulation of a theory for 
the study of signals and systems in the framework of Markov's constructive 
mathematical logic. The constructive logic introduced by Markov is built on a 
heirarchy of languages whose main constitgents are 'alphabets', 'words' and 

'normal algorithms'. Here the term theory refers to a set of constructive logical 
sentences written in a particular language belonging to this heirarchy CSia). We 
introduce in this thesis a theory consisting of five constructive logical sentences 
in addition to those of the axioms of monoids, for which the class of signal 
CM^ocessing normal algorithms constitutes a model that we refer as C<p. 

For this model , we present two clusters of results, one pertaining to its 
first order properties and another pertaining to its higher order properties. 

The notion of a first order property of a normal algorithmic signal 
processing system belonging to the model is defined here as a property that is 
expressible by a constructive logical sentence in which no normal algorithm is 
quantified. This notion is analogous to that of a first order property of a 
classical algebraic system. For a classical algebraic system A, a characterization 
theorem due to Lyndon states that if P is a first order property then P is 
preserved in a homomorphic image of A if and only if P is expressible by a 
positive sentence of the first order predicate calculus. In this thesis we present 
an analogous characterization theorem of the Lyndon type in the framework of the 
languages of Cflo;}. According to this theorem, a first order property y of a normal 
algorithmic signal processing system is preserved in a homomorphic image of the 
system if and only if P is described by a constructive logical sentence that does 
not contain the negation symbol. 

In the classical system theory, certain properties like 'continuity' and 
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'connectedness' are called 'higher order properties' because they cannot be 
described by sentences of the first order predicate calculus. Analogously the 
notion of a 'higher order property' of the model refers to a property that 
cannot be described by a constructive logical sentence without quantifying one or 
more normal algorithms. In the classical sense, higher order system properties are 
usually studied with the help of various concepts of ^neral tcc>ology. In the case 
of Cgj , however, these topological notions are not very appropriate to use 
because t the fact that they are primarily meant for infinite spaces, whereas ~ie 
basic spaces of our concern in the study of the model are finite. We find that 
it is more appropriate in our case to use Hammer's extended topology. Following 
Hammer, we introduce the concept of constructive extended filters and discuss 
their relationships with normal algorithms. 

The major results of the thesis may be summarized as follows: 

(i) With signals represented as words from certain finite alphabets 
consisting of non-numerical syntols, we demonstrate a technique by which some of 
the traditional signal processing operations, such as cyclic shifting and linear 
convolution could be implemented in terms of string manipulating normal algorithms. 
Further, with signal processing operations in mind, we propose a particular basis 
set of elementary substitution formulas using which any normal algorithm can be 
constructed. 

(ii) Fitting has outlined a string manipulation language EFS(str(L)) based on 
the notion of 'Elementary Formal Systems (EFS)' due to Smullyan. On the same lines, 
we present another string manipulation language EFS(spl(,X)) which is suitable for 
signal processing purposes. In this context, we show that a signal processing 
operation which is realized by means of a system of normal algorithms, could also 
be realized by a system of 'procedures' in EFS(spl(,A)). 

Further, with signals treated as languages of a free monoid, we introduce a 



gp arnmar called M-grsmmar that finitely specifies potentially infinite subsets 
(languages) of the free monoid. This M-grammar formalizes a specific type of 
rewriting systems for normal algorithms just as the phrase structure grammar of 
the Chomsky heirarchy does for Turing machines. A rewriting system corresponding 
to a Turing machine consists of a finite set of letter-to-letter substitutions of 
semi-Thue type that operate on Post words. Similarly, we replace every word-to- 
wor^ substitution formula of a normal algorithm by a finite set of letter-to-letter 
semi-Thue substitutions that operate on Post worn of specific kind. Since the 
resulting system of semi-Thue substitutions is essentially a Post-Turing rewriting 
system obtained from end justified substitution formulas of the normal algorithm, 
we have chosen to call it End justified Post-Turing iEPT) rewriting system. Using 
the notion of EPT rewriting systems, we outline a procedure for the realization of 
normal algorithms by Turing machines and of Turing machines by normal algorithms. 

(iii) The notions of automata and codes are closely associated with each 
other in the sense that, a subset of a free monoid is not only known as a language, 
but also as a code, and the finite state machine which recognizes it is known as an 
automaton. With this in mind, we show that the transcriptions i.e., the coded forms 
of normal algorithms are strings consisting of words from a thin biprefix code set 
X = OII^O , which is a subset of the free monoid ^A,Q^ , where ^A,Q = { 0 1 }. In 
addition, we introduce a special class of automata termed as Cyclic Normal 
,>(utomata, that characterize EPT rewriting systems. Our sttKiy of automata in this 
connection has led us to formulate the principle of normalization of automata as 
an alternative version of Markov's 'principle of normalization of algor itlms'. 

(iv) In the framework of a constructive logic which is built on the system of 
languages IFLal. we present a constructive theory Th(«) for the structural study of 

Signals and systems. Th(9?) consists of five constructive logical sentences. The 
sentence is a version of Markov's 'principle of constructive choice'. The 
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second sentence states that if a signal processing algorithm is applicable to a 

signal representation then the process of applying the normal algorithm 

terminates. The third sentence describes the functional equivalence between two 
signal processing normal algorithms having identical input-output relationships. 
The fourth sentence is about the admissibility of the operation of composition of 
normal algorithms, and the fifth is about the admissibility of their union. These 
five sentences together describe the essential characteristics of a class of 
normal algorithmic sign -I processing systems belonging to the model . 

Within the theory TWSR), we establish a homomorphism theorem analogous to one 
given by Lyndon for classical systems. Let us consider two signal processing 

systems and W 2 belonging to the model , and let and ^2 denote the two 

sets of constructive sentences corresponding to first order properties of the two 
systems respectively. Further, let jLF denote the set of constructive sentences of 
4^0 42 do not contain negation. Then our homomorphism theorem asserts that 
every constructive sentence in JlF that holds for also holds in 5)^2 • 

(v) For the study of the model Cj^ , we formulate the notion of a 
constructii^e extended filter analogous to that of an extended filter given by 
Hammer. Hammer's work deals with classical sets whereas we are concerned with 
constructive sets. A point to note here is that the concept of a set is not unique 
in constructive mathematics, for, it depends on the language chosen from to 

interpret the concept. Following Shanin, we interpret the notion of a constructive 
set in the following manner: A set is decided by a property, and a set property is 
described by a special type of formula kno^«^ as one-parameter formula from a 
languaye of {Ha5- We outline procedures for constructing two specific types of 
normal algorithms, where a normal algorithm of the first tiffje decides the 
membership of an element with reference to a given set property, and a normal 
algorithm of the second type eliminates ckplication of elements in the set. Normal 



xvii 


algorithms of these two lijDes are conjointly represented as a word from a 
specific alphabet. The transcription of this word in association with the one- 
parameter formula that describes the set property is viewed here as a 
constructive set. Based on this notion of a constructive set, we describe a 
technique of formulating different types of extended filters over constructive 
sets. We show that a normal algorithm over an alphabet Ji, is an ordered sequence 
of pairs of extended filter bases over a set of words from Normal algorithms 
are thut, seen to have a direct relevance in all potential applications of Hammer's 
topological techniques in signal processing. Erlandson has defined the following 
measures for extended filters: (i) ambiguity, <2) discrimination, (3) resolution and 
(4) distance between two filters. The same measures are redefined here in terms 
of normal algorithmic operators mapping a metric lattice of extended filters over 
a constructive set into the metric space of constructive real numbers. 





SECTION 1 


NDNNUMERICAL REPRESENTATION AND PROCESSING OF SIGNALS IN MONOIDS 


1.1 INTRODUCTION 


The term Signal Processing, as it is, ordinarily interpreted, refers to all 
thost manipulations on numerical representations of signals that are carried out 
using numerical algorithms. In this thesis we are concerned with an alternative 
interpretation in which attention is focussed on symbolic, or nonnumeric, 
representations of signals, and on their processing using symbol manipulating 
algorithms. 

The motivating factor for the choice of such an interpretation is that there 
would seem to open up through it, interesting possibilities of relating the area of 
signal processing to developments in other areas such as those of abstract 
meascT'ement theory and computable real analysis. 

Following ideas drawn from abstract measurement theory [711, and quantum 
logic [251, [521, it has been suggested [721 that the notion of a signal needs to be 
looked at in terms of a triple <X, X, ^>. In this triple, X is an algebraic or 
relational structure whose primitives and postulates are decided by empirical 
considerations about the physical phenomena the signals of interest characterize, 
and X is a numerical structure, called a representation of X, which is a 
homomorphic image of X through the mapping Formulation of X is generally 
carried out using tools of logic and formal languages. In the case of quantum 
logic, for instance, it is a logic of propositions characterizing what are called 
'yes-no experiments'. The representation X on the other hand is formulated using 
tools of Analysis, and may consist of just the real line treated as a vector space. 



or may even be a lattice of subspaces of an appropriate Hilbert space. If signals 
are to be studied in this light, then the nonnumerical interpretation adopted here 
is going to be of considerable significance. 

It acquires added significance if we take into account the fact that there has 
emerged in recent years the area of Computable Analysis C13, C83 as an alternative 
to real Analysis, in which the place of real numbers is taken over by coriHDutable 
real numbers, i.e., those real numbers whose arbitrarily precise rational 
approximations can be be obtained using omputer programs or algorithms. For 
signal processing operations and algorithms set within the framework of 
computable analysis, symbolic interpretations would seem to be of central interest. 

In general, given a string of symbols one can transform it into another 
desired string by systematically rearranging or rewriting the symbols contained in 
the given string according to a finite set of rules. A prescription which gives a 
set of such rewriting rules along with the details of how they should be applied, 
is known as a string manipulating algorithm. The concept of a normal algorithm 
refers to one such string manipulating algorithm. Essentially, a normal algorithm 
is an ordered list of a finite number of what are called substitution formulas. A 
substitution formula is analogous to a semi-Thue production of Chomsky type-0 
grammar. 


1.2 SCOPE OF THE THESIS 

In this thesis, three basic issues concerning the study of nonnumerical signal 
processing systems in terms of string manipulating normal algorithms are 
considered. They are-' 

(i) Is it possibile to implement traditional numerical signal processing 
operations with the help of normal algorithms ? 
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<ii) A set X of nonnumerical signal representations (i.e., a set X of strings of 

symbols from an alphabet, say, A) could also be called a lariguage because X is a 

¥ 

subset of the free monoid (i.e., the monoid consisting of all possible words 
from the alphabet J,, together with the associative binary operation of 
concatenation of words). Considering that rewriting systems defined by a grammar, 
as also automata, are language recognizers, can they be used to describe signal 
processing normal algorithms ? 

(iii) What re the various properties of normal algorithmic signal processing 
systems ? 

This thesis consists of a total number of ten sections, under three parts and 
each part deals with one of these three basic issues. 

The first part consists of sections i, 2, 3 and 4. In section-2, we review 
certain relevant details about the notion of a normal algorithm. In section-3, we 
provide a few string manipulating techniques which would be useful in constructing 
normal algorithms for implementing any nonnumerical signal processing operation. 
In section-4, we actually demonstrate the technique of implementing operations such 
as cyclic shifting and linear convolution of nonnegative integer seQuences by 
means of certain normal algorithms constructed over specific alphabets. 

The second part consists of sections 5 and 6. In this part, we take up the 
second basic issue of describing normal algorithmic signal processing systems as 
rewriting systems defined by a grammar and as automata. In the theory of formal 
languages, a set of words from an alphabet is defined as a language and any 
subset of it as a sublanguage. According to this definition, a nonnumerical 
representation of a signal over an alphabet could be treated as a language. Here 
we interpret the operational rule of a normal algorithm in a slightly different way 
and show that for any given normal algorithm one can obtain a functionally 
equivalent Turing machine. By this we are able to formulate a type-0 grammar of 
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Chomsky type irtihich defines the class of all normal algorithms over an alphabet as 
serial systems. In section-6, we introduce the notion of a Cyclic Normal 

Automaton normal algorithms and demonstrate with an example how a cyclic 

normal ^‘-Jtomaton over a nonnumerical alphabet recognizes a language 
corresponding to a signal space. 

The r-emaining sections 7, 8, 9 and 10 form the third part of this thesis. In 
this part, we consider a structure = <Jf^ , o , ~> (where denotes a 

class of nonmal algorithms over J. , o denotes the operi ion of composition and =£ 
denotes tHe relation of functional equivalence) which finitely specifies 
nonnumerical signal processing operations and we develop a theory for it in a 
language o-F constructive logic. In addition, we provide constructive 
interpretations to (i) Lyndon-Keisler homomorphism theorem and (ii) Thampuran's 
extended topological filters and show that the properties of a Cl^j-type signal 
processing system could be studied with the help of either of these two. Section-7 
provides a theory denoted by Th(SR), for the structure and a short list of 
properties o-F C<^-type systems. In section-8, we consider Lyndon-Keisler 
homomorphism theorem and its improved version by Fujiwara. We present a 
charaterization theorem which is analogous to Fujiwara's version of the 
homomorriiism theorem for C^j-type systems, in a language of constructive logic. In 
secticr>-9, reformulate the notion of an extended filter in constructive terms 

(the resulting filter is called a constructii^e extended filter) and establish a 
corsTection fc>« tween the notions of a normal algorithm and a constructive extended 
filter. In s»ct ion-10, we study, on the lines of Erlandson, certain computational 
aspects of esx tended topological filters in terms of quantifiable measures such as 
(i) ani>iguity of a filter, (ii) discrimination of a filter, (iii) resolution of a filter 
and (iw> distaincse between two filters. In so doing, we describe these measures in 
terms of normal operators acting from a metric lattice of constructive 
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extended filters into the metric space of constructive real numbers. 

1.3 SIGNALS, SYSTEMS, MONOIDS AND J-CLASS RELATIONS 

While the precise definitions of various terms to be used in the thesis will be 
introduced in the text as the need arises, it is appropriate to clarify here itself 
as to how we intend to interpret the two basic terms - signals and systems. By a 
signal we mean a word from a free monoid of an alphabet A ( i.e., the monoid 
consisting of all possible words from the alphabet A and the identity element A 
that is also known as the null string, together with the associative binary 
operation of concatenation of words ). By a signal space we mean the free monoid 
A^ itself or a subset of it. By a signal processing system we understand a binary 
relation on A^, with the first members of the ordered pairs constituting this 
relation called inputs and the second members called outputs. 

An alternative way of looking at systems is that in terms of four equivalence 
relations; introduced by Green C2£3, which hold for semigroups as well as free 
monoids E261. These are - 

(i) Right or 3t-class congruences; 
a, b € lA^t sStb if aw4,^= bv4, 

(ii) Left or Jt-class congruences; 
a, b € A^ , aiJo if A a — A b 

(iii) 3-class congruences; 

a, b e A*, aSb if A*aA*= A*bA* 

(iv) «-class congruences; 

a, b € A*, aiKb if a3tb and aXb 



DEFINITION i.2.1 
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An alphabet together with a finite set of 3-class equivalence relations is 
called an 3-class presentation of the free monoid Similarly one can obtain four 
more types of presentations based on the remaining four equivalence relations 3), 
%, L and 

We may now say that a system is an 3-cIass presentation. 

1.4 STUDY OF SYSTEMS IN TER S OF ASSOCIATIVE CALCULI 

With systems treated in this manner, we find the notion of an /4ssociatii/e 
Calculus of Markov [233 to be of immediate use because of the fact that this notion 
has a direct correspondence with the notion of an 3-class presentation of a free 
monoid. The correspondence between these two notions is described below. 

Let us consider an alphabet and a symbol 4 — ^ which is not in J.. Let 'a' and 
'b' be two strings of symbols from the alphabet J.. Now, the string a < — ^ b from 
vA U C < — > ) is called a defining formula in the theory of associative calculus 
C233. By virtue of this formula one can transform a given string into another in 
the following manner: If the given string is 'uav' it is transformed into 'ubv' where 
u and V are two more strings in the free monoid .A . On the other hand, if the 
given string is 'ubv' then it is transformed into 'uav'. A string (sequence of 
symbols) from an alphabet is also called a u/ord. Now, one can clearly see from the 
above technique of transforming a word into another by virtue of a defining 
formula, that a defining formula is one kind of interpretation of an 3-class 
equivalence relation. For example, the defining formula a ( — ^ b over an alphabet 

vA can be seen to have a direct correspondence with the equivalence relation a3b 

¥ 

in the free monoid J, . A finite set of such defining formulas (3-class relations) 
over an alphabet J, is called a defining system. Let us denote a defining system by 
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the symbol JD. 

ASSOCIATIVE CALCULUS 

Now, the couple ®> is what is known in Markov's terms as an >lssociatii/e 
Calculus. Let us denote an associative calculus over an alphabet J, by the symbol 
ft such that ft = <v4„ 1!D>. 

An associative calculus ft over an alphabet A. leads to operations on certain 
words in A not by means of prescription, that is, to act precisely in such and 
such way using the 3-c iss relations of the defining system ID in such and such 
sequence; but by means of permission, that is, to apply the relations without 
imposing on them any limitations in their choice and their repetitive use. 

An associative calculus ft is said to be applicable to a word P in the free 
monoid A only when the word P is transformed into another, say Q, after an 
exhaustive use of the defining system JD. In such a case, the word P is said to be 
equivalent to the word Q in ft which is denoted by ft: PH Q. Thus an associative 
calculus ft over an alphabet -4, generates a system of words which are 
equivalents with respect to its defining system JD. The system of words along 
with the associative binary operation of concatenation o , forms a mathematical 
structure K =<Sj^ , o> where K is called an Associatiu'e System. 


Ik 

Thus, with the free monoid A being treated as the non-numerical formal 
structure of a signal space, an associative calculus over the alphabet A admits 
of being treated as a nonnumerical signal processing system. 


In other words, with a signal space over an alphabet A, one can construct a 
suitable associative calculus over A in order to carry out a desired non- 
numerical signal processing operation by stpribol manipulation. 
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1.4.i UNSOL VABLE WORD PROBLEMS IN THE USE OF ASSOCIATIVE CALCULI 

In spite of its neat formalism, the theory of associative calculi and systems 
suffers from various word problems. One of the problems is about the existence of 
an algorithm which would ascertain the equivalence of a word Q to another word P 
in an associative calculus. Another problem is about the existence of an algorithm 
that would precisely recognize an invariant property of an associative system. The 
first problem has been negatively solved independently by Post and Markov C2i3. 
Mi kov has demonstrated the unsolvability of the second problem C231. 

All these amount to saying that one cannot conveniently carry out various 
non-numerical signal processing operations in terms of associative calculi, and it 
is mainly because of the following two reasons: 

(i) All the word problems of the theory of associative calculus were found to 
be tied up with the need for a precise definition of the notion of an algorithm 
which is closely linked with the notion of computability. 

(ii> Monoid property of an associative calculus is not a hereditary property. 
The notion of a hereditary property is to be understood in the following manner: 
Let Sti and Hz be two (associative) calculi over the alphabets vii and Az 
respectively. By a homomorphism of into Siz we mean an algorithm, say Jf, 
(precisely known as a normal algorithm; Ref. Section 2 for details) over the union 
of and Jiz which transforms each and every word from into some word from 
Az and for any P, Q € the condition Jf (PQ) = Jf<P)Jf(Q) holds. The homomorphism 
becomes an isomorphism if the following condition is satified: jii: P U. Q ct Siz : 
Jf(P) i_L Jf(Q). In other words, two calculi and Siz over the alphabets Ai and Az 
respectively, are called isomorphic to each other only if the derivability of Q 
from P in fti implies the derivability of Jf(Q) from Jf(P) in Siz and vice versa. Now 
let us consider two calculi Sii and * 2 . If there exists an isomorphism of into »2 
then fti is said to be imbeddable in Siz. There can be some properties of Siz which 
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are preserved in fti. In general, those properties of an associative calculus which 
are preserved in every one of its imbeddable calculus are known as hereditary 
properties . 

Since signal spaces are treated here as monoids, all the invariant properties 
of systems which are preserved in their homomorphic images cannot be 
conveniently studied using associative calculi. 

So we turn to Markov's notion of a Normal Algorithm for symbolic signal 
processing. 



SECTION 2 


NORMAL ALGORITHMS 

2.1 WHY NORMAL ALGORITHMS ? 

In the precise formulaticsn of the concept of an algorithm, notions of 
recursive functions, Turing machines. Post's working hypothesis and Markov's 
normal algorithms play equival it roles. 

While the first three of these notions occupy a well-established place in 
theoretical computer science and other related areas including that of signal 
processing, the notion of normal algorithms have received very little attention 
from the point of view of applications in these areas. Potentials for such 
applications would, however, seem to be erwrmous, considering the fact that normal 
algorithms play a key role in the works of Markov [233, Shanin C313, [323 and others 
on constructive real numbers and Analysis. Our choice of normal algorithms from 
amongst the equivalent notions just mentioned is based on these considerations. 

2.2 WHAT IS MEANT BY A NORMAL ALGORITHM ? 

In what follows, we review very briefly that part of the formalism from 
Markov's monograph which is essential for describing the concept and the working 
principle of a normal algorithm in general [233. 

By an alphabet we mean a finite, unordered list of primitive symbols known as 
letters. For example, = C 0 I - 3 denotes an alphabet A which contains the three 
letters O, I and - . Binary operations between alphabets are interpreted in exactly 
the same way as the set-theoretic operations such as union, intersection and 
difference are understood. We shall use the same symbols U , n and \ to denote 
respectively the union, intersection ard the difference operations between 
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alphabets. Similarly all the relation symbols such as C , C , 2 , 3 and other 
symbols like € and € are also used, which convey the same meanings as they do in 
set theory. 

By a generic i^ariable, we mean a variable whose values are the letters taken 
from an alphabet, kie shall use the symbols 6 , J? and U and their subscripted 
versions to denote generic variables, irrespective of the alphabets over which 
th^ range. But, whenever a generic variable is used, we shall defirre the alphabet 
over whi t it will range. 

A string of letters drawn from an alphabet J, and written one after another is 
called a ttford from the given alphabet. The word consisting of no letters is called 
empty word or the null word, which is denoted by the st^nbol A- The concatenation 
of two words from an alphabet is also a word from the same alphabet. 

DEFINITION 2.2.1 £26] 

A word U is called the left factor of a word P if the condition UV = P holds 
for P, where V is another word. In this case, V is called the right factor of P. In 
general, a word V is called a factor of another word P if the condition UVW = P 
holds for P where U and V are two other words. 

In a word of the form UVW, the factors U and W are called the delimiters of 
the factor V. 

Now let us consider an alphabet A and two other symbols k and • that are 

not in A. Then words of the types; <i) P » Q and (ii) P Q from the alphabet 

^ (j £. are called substitution formulas; the former is called a simple 

substitution formula and the latter a terminal substitution formula. P and Q are 
words in the free monoid A of the alphabet A, and are known as the left and the 
right parts of the corresponding formula. 

Substitution formulas of the types <i) h Q (ii) P h and (iii) 

whose blank parts are empty words, are admissible formulas, and those of the first 
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type, we call injection formulas. 

By application of a substitution formula to a word, we mean the replacement of 
the left part of the formula that occurs in the given word, by the right part of 
the formula. 

An ordered list of simple and terminal substitution formulas is called a 
scheme. Let us denote such a scheme by the symbol &. Now, the ordered pair 
<>A, ©> consisting of a specific alphabet A and a scheme & is known as a normal 
algorithm, denoted in general by the symbol >f. By tht operation of Jf on a word, 
say P, we mean the application of the formaulas of its scheme to the word P in 
accordance with the following rules: 

(i) If none of the left parts of the substitution formulas of Jf is a factor of 
P, then Jf is not applicable to P ; symbolically we say -!Jf<P). 

<ii) If atleast one of the left parts of the substitution formulas of Jf is a 
factor of P, then Jf is definitely applicable to P (i.e., P is an input to Jf> and we 
say !Jf<P). 

(iii) If !Jf(P), then from the ordered list of Jf, the first substitution formula 
that is applicable to P is identified and the right part of the identified formula is 
substituted for the first occurrence in P this formula's left part. Let the result 
of this substitution be the word Q. If the applied formula is of the terminal type, 
the word resulting from the substitution is treated as the desired word 
transformed by Jf and we write Jf: P !-•(}. If the applied formula is of the simple 
type, then the word produced by the substitution is again subjected to Jf as 
outlined in the earlier steps. In this case, we express the one-step transformation 
as Jf; PhQ. Tbffi process of applying Jf can stop at some step either naturally (i.e., 
when no formula could be applied further) or by means of a terminal formula. 

In general, instead of the expression Jf: PqI-P^ , Jf : PiHP2 ' ■ • ' 
we shall use the briefer expressions Jf: Po^-Pi^-P 2 ^“•-•^•Pn or Jf: Pq Pn or 
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>f: Pq Pn • Similarly, instead of the expression Jf: Pof-P^ . Jf: 

Pn-iP’Pn we shall use the briefer expressions JC : PqI-P^ hP2l- -H*Pn of' 'N' ; 

Pq ^n* Pn Pq f=* Pn • 

input 



output 


output 

Fig. 2.2.1; Functional block diagram of a normal algorithm 

The rules are illustrated by the diagram shown in Fig. 22.1; here the symbol S 

stands for the empty word A if the corresponding formula is simple, and for the 

symbol • if the formula is a terminal one. 

Now, we show that a normal algorithm say JC, in an alphabet J. has a direct 

¥ 

correspondence with an J-class presentation of the free, monoid ^ , which is 
defined by certain J-class partial order relations. The notion of an J-class 
presentation of a free mmoid has been explained in subsection 12. Let a 
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substitution formula P ^ Q be contained in the scheme of Jf. This formula is 

applicable only to those words of for which P is a factor. In other words, this 

¥ ¥ ¥ ¥ 

substitution formula is a partial map of the type: A PA ► Qji which in turn 

is interpreted as the partial order relation P3Q. So, a normal algorithm Jf with the 
scheme © consisting of n sLtostitution formulas, is an 3-class presentation of the 
free monoid A defined by an ordered list of n 3-class partial order relations 
corresponding to the n substitution formulas. 

2.3 HOW TO CONSTRUCT NORMAL ALGORITHMS ? 

2.3.1 RELEVANT NOTATIONS AND DEFINITIONS 

In theoretical studies dealing with computations, it is customary to assume 
that there is no scarcity for storage space and there is no restriction on the 
repeated use of an algorithm. Markov refers to this assunption as the concept of 
potential realizability t233. In keeping with this concept, we are allowed to 
construct alphabets by adding a new letter to every realized alphabet; to 
construct words by concatenating a letter to every realized word and to construct 
normal algorithms from ones already constructed. Their realization is potential, 
that is, the process of their construction is not limited by insufficient space and 
means. 

Let be an alphabet. Then, the construction of the free monoid A is 
potentially realizable. 

DEFINITION 2.3.1 C263 

X 

Let P be a word in A where A is an alphabet and y. be a letter in A. Then 
the length of the word P, that is, the number of symbols required to form P is 
denoted by P|. The number of occurrences of a letter y in P is denoted by Ply,. 
Pitt - PI 


Note that 
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DEFINITION 2.3.2 [263 

A word P is called multilinear if for every letter jtl in the alphabet A the 
condition < 2 holds for P. 

In the study of normal algorithms, there is a need to distinguish between the 
equivalence of normal algorithms, and that of the words representing them. As we 
shall see later, different words may represent the same normal algorithm. In order 
to take care of this distinction, three different types of equivalences are used. 
DEFINITION 2.3.3 C233 

Two words P and Q from an alpahbet A are graphically eciuiyalent only when 
they are composed of the same letters, arranged in the same order. Their 
equivalence is denoted by P=Q, where the symbol = represents the relation of 
graphical equivalence. 

DEFINITION 2.3.4 C203 

Let and JC 2 ^^o normal algorithms in an alphabet A. If transforms a 
particular word P from A into a word Q from A, and J (’2 also transforms the same 
word P into the same word Q, then and Jf 2 are said to be conditionally 
OQuivalent with respect to the word P. Now, if and Jf 2 have the same set of 
input-output pairs consisting of words from the free monoid A , then the two 
normal algorithms are said to be functionally eatuivalent with respect to every 

X 

admissible input P from A and we express it as Jf j^(P)ss;Jf 2 [P). At times we use a 
briefer expression Jfj^aiJf2 iristead of jr 2 <P). 

DEFINITION 2.3.5 [233 

Let P be a word from an alphabet A. The first symbol in the word P is known 
as its initial and the last symbol in P is known as its ending. Any factor of P 
starting with the initial of P is known as the head of P. Similarly, any factor of P 
ending with the ending of P is known as the tail of P. The null string A, is an 
empty word from the alphabet A and so it cannot be the head or tail of P. 
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DEFINITION 2.3.6 C233 

Lei P be a word from an alphabet J,. Then, the word that is obtained by writing 
the sequence of letters of P in th« reverse order is called the immerse of the 
word P and is denoted by P"^. 

DEFINITION 2.3.7 C233 

Two words P and Q from an alphabet vA are said to be relaiivel<d prime to each 
ott«r if P and Q do not have any common head or tail. 

DEFINITION 2.3.8 C231 


Let us consider an alphabet of two symbols, say, J. = { a $ }. Then, words of 
the form ajS«, aj3j3j3a, and so on, are called (a.&^-links. Any word from this 

alphabet which can be factored into (a,/3)-links is called an (a,$)-chain. 

In general, a normal algorithm Jf is called a normal algorithm over an alphabet, 
say A, if it is constructed in some extension of A <i.e., in the dis;k)inl union of 
the alphabets A and 8, where 8 is called the alphabet of auxiliary symbols). 

Auxiliary symbols are used as markers that separate desired factors in a 
word from A. 

A normal algorithm meant for a specific operation, say • on certain words 
from the alphabet A, is denoted by Jf*. The symbol • may be replaced by any 
conventional operation symbol or by a suitable acronym which denotes the required 

operation. At times, it may be required to indicate the domain D of the operation 

* • 

corresponding to Jf . Then the normal algorithm is denoted by Jf . The symbol D 

D 

may be replaced by any symbol denoting a finite or a potentially infinite set of 
words from the given alphabet. If the domain of an operation of a normal algorithm 
JC over an alphabet A is the free monoid A itself, then we shall not, in general, 
indicate the domain. But if it becomes necessary that we should indicate the 


domain, then instead of denoting the normal algorithm as JT » 

A 

as Jf in order to reduce the notational complexity. For example, 
A 


we shall denote it 

* 

Jf denotes 

v4,in,A2 
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a normal algorithm that carries out the operation • on words in the free monoid 

y • 

(vtifYAz) where and Az are alphabets; wheras, Jf denotes a normal algorithm 

XrtY 

that carries out the operation • on words that are common to both the sets X and 
Y of words from the given alphabet. 

2.3.2 GUIDE LINES FOR CONSTRUCTING SIMPLE NORMAL ALGORITHMS 

In this subsection, we provide certain guidelines that are helpful in the 
constriction of a normal algorithm meant for a desired operation on words. . efore 
that, we present two simple exanv^les of normal algorithms and see how they work. 
EXAMPLE: 2.32.1 

Let us consider the alphabet vi = C a b }, and the normal algorithm jf**^*^ whose 
scheme is as follows: 

j^flNN . 

Substitution formulas Formula number 



The substitution formulas of this scheme convey the meaning that both the letters 
a and b are to be substituted by null strings A if they are found in any given 
word from J,. Since the alphabet consists of only two letters a and b, it can be 
seen that annihilates < erases) every word that is obtained from A. So, the 

construction of an annihilating normal algorithm over an alphabet consisting of n 
letters, requires n substitution formulas of the type shown above. However, one 
can simplify the scheme of over any arbitrary alphabet J,, by making use of 

the generic i-'sriable H as shown below: 

Substitution formula Formula number 


il 


(ii € vt) 


(0) 
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EXAMPLE: 2.3.22 

Lei us lake anolher example of a normal algorilhm lhal righl-adjoins 

(concalenales) a parlicular word say Q, to any other word, say P, from a given 


alphabet In this example we observe the significant use of an auxiliary symbol. 
: Substitution formula Formula rsjmber 


(U e Ji, ( 0 ) 
a i M 

<Q € A*) <1) 

( 2 ) 

The working of is demonstrated with the help of the following exarrole : 

Let us consider the alphabets = C 0 I ) and 8 = C « 3 and the words P = ODI and 
Q = OIO from Aq. right adjoins Q to P in the following manner; 

First the auxiliary symbol « is left adjoined to the left of P (formula (2)), so 
that the word OlOl is transformed into aOIOI. Then a moves to the right through the 
word (formula (0)) so that the word aODI is transformed into OlOla after four 
steps. Now, a is replaced by the word OfO (formula (i)) so that the word OlOla is 



transformed into the word OiOlOD and the process of applying Jf*’**'^ terminates. 


causes the following elementary transformations of P = OlOl : 


Sr .No. 
0 
1 
2 

3 

4 

5 

6 


Elementary transformations Formula used 
0101 (input string) 
aOIOI 2 

OalOl 0 

OlaOl 0 

OlOal 0 

ODla 0 

OlOIOD i (process terminates) 


In principle, any number of auxiliary symbols may be used in a scheme. 
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However, as Markov has shown in [233, one needs almost two auxiliary syrrtools in 
constructing any type of normal algorithm. This is achieved by means of an 
operation that Markov calls translation. As we shall use this notion of translation 
later, in section-6, we feel that a brief description of it, here, would be 
appropriate. With this idea in mind, we recall some details of it from [233. 

Let us consider a two-lettered alphabet, say, $ = {a i83 and an alphabet of 
auxiliary symbols, say, 8 = Crj^r 2 ... Tn) in addition to the basic alphabet A. Let 
C = and 5 = J,U8 and % be the generic variable that ranges in §. Then the 

translation of a letter g from the alphabet 5 is defined as (i) g, if g € vt ; <ii) 

[g3^s: , (i^i^n) if g€ 8. In other words, all the k letters from the alphabet 8 

are represented as (a,]8)-links from the two-lettered alphabet ®. Now, the 
translation of a word P = gj^g 2 - -Si- -S|^ from the alphabet 3 is obtained by replacing 
each letter g^ ; (l^i^k) in P, by its corresponding translation. The translation of 
the word P is then denoted by [P3^. [NOTE: [A3^=A3. In the same manner, the 
translation of a normal algorithm Jf over the alphabet 5 is obtained by replacing 
the left as well as the right parts of all the substitution formulas of the scheme, 
by their corresponding translations. 

Based on these details, we now give a result of Markov, translation theorem, 
which forms one of the central notions of constructive mathematics. 

THEOREM 2.3 .2.1 [233 

Let a normal algorithm JC be applicable to a word P from an alphabet A. Then, 
[Jf3‘^( CP3'^)K[Jf(P)3'^. 

Thus, generic variables and auxiliary symbols could be seen to play an 
important role in the construction of normal algorithms. 

Now let us see the guidelines that are useful in constructing a normal 
algorithm for implementing a desired operation on words. 
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GUIDELINES 

(i) Normal algorithms are applicable only to words from alphabets. So, by 
computation we mean the transformation of a given word into a desired word 
[Appendix A.33. Now, the computation for which a normal algorithm is sought, has to 
be broken into certain basic symbolic operations similar to what is done to a 
problem prior to writing a computer program for it. 

(ii) The order in which the basic symbolic operations of the computation 
pi cess are to be carried out, is identified. 

(iii) Substitution formulas have to be constructed corresponding to each 

basic operation of the computation process. For example, let us take the case of 
constructing a substitution formula corresponding to the basic operation of 
addition of any two positive integers. We proceed in the following manner. Firstly, 
we take two positive integers, say 3 and 5, and see how they are added 
symbolically. The integers 3 and 5 are coded as the words ill and Hill from a one- 
lettered alphabet ^ = {I}. The coded words are then represented as a single 
string 111*11111 with the auxiliary symbol * acting as a marker. Now if we erase the 
marker * , the resulting string llllllil corresponds to the integer 8. By this method, 
the operation of addition of any two positive integers can be carried out 
symbolically. The substitution formula that carries out this symbolic operation is: 
* h . 

(iv) Let us assume that the given computation can be carried out by means of 
a sequence of b basic symbolic operations. As outlined in the previous step, we 
can construct one or more substitution formulas corresponding to each of the b 
basic operations. We note that a basic operation on a word transforms it into 
another word and the transformation due to this basic operation depends on the 
word that has been transformed by the previous basic operation. Given an ordered 
sequence of b basic symbolic operations constituting a computation and an input 



21 


word P, we exhaust the possibility of carrying out all the other basic operations 
starting from the b^*^ operation before trying out the first operation and we 
repeat this procedure for every transformed word. By doing this, we are in a 
position to maintain the dependency relation in the sequence of basic operations. 
So, while writing the scheme, the block of substitution formulas corresponding to 
the b^*^ basic operation has to be written first. Next, the block of substitution 
formulas corresponding to the (b-1)^*^ basic operation, has to be written. This 
procedure has to be continued till the block of substitution formulas 
corresponding to the first basic operation is written. 

(v) The left parts of the substitution formulas contained in a block might be 
of different lengths. Now, each block has to be reconstructed with their 
substitution formulas written in the decreasing order of lengths of their left 
parts. This is done in order to maintain the dependency relation between the 
substitution formulas in a block. 

The ordered list of all the substitution formulas constructed in the above 
manner, gives rise to a scheme of the required normal algorithm. 

2.3.3 BASIC THEOREMS ON THE COMBINATION OF NORMAL ALGORITHMS 

Markov presented in his monograph, a series of theorems that allow the 
construction of new normal algorithms using certain algorithms that have already 
been constructed. In view of their importance in constructing normal algorithms, we 
list these theorems here. For the proofs, the reader is referred to C233. 

THEOREM 2.3 .3.1 

For any pair of normal algorithms Jfj and Jf 2 » constructed over alphabets J. 
and 36 respectively, one can construct a normal algorithm Jfg over the alphabet C, 
where C = ^U36 , such that = Jf 2 (Jfi(P» where P is a word from C. This is 


known as the composition theorem. 
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THEOREM 2.3.3.2 

For any pair of normal algorithms X'l and X 2 constructed over an alphabet J,, 
one can construct a normal algorithm Jfg over A such that JfaCP) s= Jfi(P)Jf 2 (P), 
where P is a word from A. This is known as the union theorem. 

THEOREM 2.3 .3 .3 

For any normal algorithms Jfi , Jfg » and Jfg over the alphabets A, S and C 
respectively, one may construct a normal algorithm over the alphabet 5, where 
5 = J,U3BUC, such that 

(i) Jr 4 (P) ~ JTatP) ( P is a word from 5 and JfatP) = A ) 

ai) >f 4 (P) Jf i(P) ( P is a word from 5 and JfsCP) ¥ A ) 

This is known as the branching theorem. 

In many cases, the need arises for the repeated application of a normal 
algorithm over and over again until the resulting word satisfies a specific 
condition. In such cases, the following theorem, known as the repetition theorem 
is of use. 

THEOREM 2.3 .3 .4 

For any two normal algorithms Jfi and Jfa over the alphabets A and SB 
respectively, one may construct a normal algorithm Jfg over the alphabet C i\here, 
C = viUSB such that Jfg transforms a word P from C into a word Q if and only if 

there exists a sequence of words Pq, Pj^, P 2 > -i Fn ^ ) satisfying the 

following conditions •• 


(i) 

Po = P 


(ii) 

Pi =>ri(Pi.i) 

; ( 0 < i n ) 

(iii) 

Pn = Q 


(iv) 

Jf2<Pi) ¥ A ; 

( 0 < i < n ) 


(v) 


Jf2<Pn) = A 
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To summarise, we have thus arrived at a level of understanding as to <i) why 
we prefer normal algorithms for our study, (ii) what normal algoritt»ns are, (iii) how 
normal algorithms over a particular alphabet are interpreted as 3-class semi-Thue 
presentations of the corresponding free monoid and (iv) how we can go about 
developing a few, in order to meet out any desired computational requirement. 

In the next section, we shall see some important techniques using i^ich we can 
actually construct normal algorithms for implementing desired signal processing 
operations. 



SECTION 3 


NORMAL ALGORITHMS FOR IhPLEhCNTING 
NOhMJMERICAL SIGNAL PROCESSING OPERATI(>IS 


In this section, we deal with the construction of normal algorithms for certain 
basic operations of signal processing. 

3.1 PRELIMINARIES 

The term string msnipulation is interpreted in a restricted sense, as a 
rearrangement of letters in a given string consisting of symbols drawn from an 
alphabet. In general, by string manipulation we mean the transformation of a given 
string into another desired string by either a) rearranging the letters contained 
in the given string in a desired fashion, or (ii) erasing arbitrary symboKs) in the 
given string, independent of their position or <iii) introducing arbitrary symboKs) 
anywhere in the given string. 

In the course of constructing normal algorithms for implementing various 
traditional signal processing operations, we found that any desired normal 
algorithmic signal processing system could be constructed with the help of a 
minimal set of certain basic and advanced string manipulation technicfues. The 
following ctefinitions are required for explaining those techniques : 

DEFINITION 3.1.1 [313 

Let us consider an alphabet A, and an extra sijnbol * which is not in A. Then, 

¥ 

a word of the form P*Gl from ^U{*3/ P/Q € A , is defined as a f-pair of words 
from A, P its left f-term and Q its right 9-term. Likewise, with P,Q and R as words 
from A, P9Q9R is a 9-triple of words from A, Q its kernel, Pi its left delimiter 
and *R its right delimiter. P, Q and R are called i-terms. 
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DEFINITION 3.1.2 

(0*)-terflj is a word of the form OP3f where P is from an alphabet Jk. and the 
symbols 0 and * are extra symbols i<rfiich are not in ./i. Me prefer to call the 
syn^ls □ and ^ , delimiters. 

DEFINITION 3.1.3 

(IIE*)-term, or a ^-delimited term is a word of the form *P* where P is from an 
alc^abet J,. 

DEFINITION 3.1.4 t263 

Let P and Q be two words from an alphabet A, where P can be factored as 

Pj^P2^3 ® 01^2^3 shuffle of P and Q is the subset of 

the free monoid A , defined by : 

P t Q = C R I R = Pj^Q^P 2 Q 2 -PiQi -PnQn i i^i^n ; niO ; Pj , Qj € A*-, 
DEFINITION 3.1.5 

Let us consider the shuffle P J Q where PI K3I. In such a case, P 1 Q is 
known as an improper shuffle. 

DEFINITION 3.1.6 

Let P and Q be two words from an alphabet A, where P can be factored as 

¥ 

*^1^2^3 "^f^' Q-dilution of P is the subset of the free monoid A , defined by : 

P T Q * C R I R = PiQP 2 QP 3 QPi QPn ; lii^n ; n > 1 ; P^ , Q 6 

With thesd definitions, we are now ready to examine the following string 
manipulating techniques: 

3.2 BASIC STRING MANIPULATING TECHNIQUES 
3.2.1 TRANSPOSITION TECHNIQUE-TYPE 1: 

Interchanging the positions of two adjacent symbols in a string is known as 
transposition. As per this technioL^, we can transpose two specific symbols in a 


string. For example, let us consider the alphabet of arabic numerals and a 
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substitution formula 23 > 32. This formula is applicable to the word 105723649 

and the transformed word is 105732649. 

3.2.2 TRANSPOSITION TECHNIQUE-TYPE 2: 

In this technique, we use generic variables along with specific symbols. The 
purpose of using this technique is to shift a specified symbol in a string towards 
the left or the right. For example, let us consider the alphabet of arable numerals 

and two substitution formulas : FI; 3/1 ^ Il3 and F2 ; a4 ^ 4jU. M is a 

(eneric variable that ranges over the given alphabet. Let P = 12345.'7 be a word 
to which both the formulas FI and F2 are applicable. If FI is applied to P just 
once, the word 1234567 is transformed into the word 124^^67. On the other hiand if 
FI is repeatedly applied, the wcw^ 1234567 is ultimately transformed into the word 
1245673 and the process of applying FI is naturally terminated. In the same way, 
by applying F2 just once, P can be transformed into 1243567 or by applying F2 
repeatedly, the word P can be transformed into 4121^67. 

32.3 TRANSPOSITION TECHNIQUE-TYPE 3: 

In this technique, we make use of auxiliary s^^nbols along with generic 
variables. Let us consider an alphabet A and an auxiliary symbol a t^iich is not in 

A. Then, substitution formulas of the ttzPes; (1) ail ^ jla and (2) Fa ^ aF 

where fl and F are individual generic variables which range in J., constitute this 
technique. For example, let us refer to subsection 2.3.2 where the scheme of the 
normal algorithm is provided. As per the 2n4 formula of the scheme, the 

auxiliary symbol is introduced in a given string. It is shifted to the right end of 
the string by means of the repeated application of t4Te 0^^ formula of the scheme, 

that is, all ^ tla which falls mder this category. One would find a frequent use 

of this transposition technique i^rfiile constructing various normal algor ittms. 

t Note : Formulas of the ttpe ajS ► j8a , where a and $ are auxiliary variables, 

also belong to this category. 1 
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32 A TRANSPOSITION TECHNIQUE-TYPE 4: 

Techniques of tvpes 1 to 3 are of use in situations where at least one of the 
pair of stools to be transposed is a specific one. There are, however, situations 
in which we are interested in carrying out certain manipulations such as (1) right 
adjoining the initial of an arbitrary word to its ending, or (2) left adjoining the 
ending of a word to its initial. Since the initial and the ending of an arbitrary 
word are unknown, we cannot specify the corresponding stpnbols which have to be 
right (left) shifted. 

Therefore, we introduce here transposition tecivuque-type 4, which makes use 

of substitution formulas of the types (1) SfJ^ ) , a right shift formula and 

(2) Hfr ► frjli , a left shift formula. Here, $ and T are auxiliary symbols and tl 

and f are generic variables. 

A repeated application of the first formula causes a complete right shift of 
an arbitrary symbol represented by jU- which is to the right of the shift operator, 
that is, the auxiliary symbol S. Likewise, a repeated ac^lication of the second 
formula causes a complete left shift of an arbitrary symbol represented by € 
which is to the left of the shift operator, that is, the auxiliary symbol F. 

The following examples illustrate the use of this technique : 

Let us consider the alphabet vi^Cabcd}, and the alphabet of auxiliary symbols 
8 = { a S r ). Let tl and f be the generic variables that range over A, and P = abed 
be a word from A,. 

EXAhPLE 32.4.1: Normal algorithm for right shift operations 

If'®; Formula nuirtoer 

Stl^ > eSjU (0) 

6 (i) 

► S (2) 

Now, abed h Sabod I- bSacd |- beSad f- bodSa !-• beda 
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EXAMPLE 35.4.2 : Normal algorithm for left shift operations 




Formula number 

uer - 


(0) 

cad — 

—4 PirOCt 

(1) 

OM — 

-4 r 

(2) 

r — 

— 

(3) 


-4 a 

(4) 


Now, abed (- aabed (- aabed h abacd h- abead (- abeda I- aaboda I- 

aabeda h abaeda h abeoeda h abedaa 1- abedT h abdre I- 
adPbe h drabc dabc 

Besides carrying out transformations of symbols in a given string, at times we 
also need to have some of the synd^ols removed or erased from them. For this 
purpose, we introduce here the following annihilating techniques. 

3.2.5 AhMHILATION TECHNIQUE-TYPE 1 

By annihilation of a syir^l in a word, we mean substitution of that symbol by 
null string A- By annihilating formula-type 1, we mean a substitution formula whose 
left part is the symbol to be erased and the right part is the null string. 

For example, let ,A = Cabcd}bean alphabet and M be a generic variable in 
A. Then, depending on the need one can incorporate in a scheme, any of the 
following basic annihilating formulas : 

Fi : il f ; F2 : a k ; F3 : b k ; F4 : c » and F5 : d > . 

Let P be any word from A. Then the following statements are valid ; 

(1) If FI is applied to P just once, the initial of P will be erased. 

(2) If FI is applied res^atetfly, the entire word P will be erased. 

(3) If F2 is applied to P just once, the first occurring letter a in P will be 

erased. 

(4) If F2 is applied repeatedly, then Pla = 0 
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(5) Statements <3) and (4) are true for other formulas F3, F4, and F5 also. 

3.2.6 ANNIHILATION TECHNIQUE-TYPE 2 

Annihilating formulas of type i cannot, in general, be used fcr erasing a left 
factor or a right factor of a given string. To be more precise, let us say that Me 
have to erase the right factor V in a word P = UV. Assume that at least one 
common symbol occurs both in U and V. Then, in the process of erasing all symbols 
in V with the help of type i annihilating formulas, the common supbol present in U 
will alsc- get erased. 

In order to overcome this difficulty, we provide here amihilating formulas of 

the following types; FI; Oil > 0 and F2; Ft 1 t , where the auxiliary symbols 0 

and T we call right annihilator and left annhilator respectively, jti and 6 are the 
generic variables over an alphabet J,. Annihilation of the right factor V of a 
given word P from J., where P = UV, is carried out first by rewriting P as UOV and 
then by applying the formula FI repeatedly till V is erased. Now by allying the 

type 1 annihilating formula; 0 ^ to the word LO we obtain the word U. Likewise, 

we can use formula F2 for annihilating the left factr of a word. 

The following example illustrates the use of these two annihilators in erasing 
the initial and the ending of any realizable word from a given alphabet. 

EXAMPLE 3. 2 .6.1. 

Let us consider the alphabets w4 = {ab3;8 = CaT03; and a word P = abba 
from J,. 

■■ Formula ntmber 

TM ^ tlT (.il € v4) <0) 

Ota > Ot (1) 

Dtl » (2) 

fT »• (F € (3) 


a 


(4) 
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EXC 

Now, Jf : abba h aabba aaabba h Orabba t- OaTbba h Dabrba |- 

Oabbra h Oabbar |- bbar H* bb 
32.7 AWIHILATION TECmiQUE-TYPE 3 

Finally we introduce a technicue for carrying out string manipulations such 
as-' (1) annihilation of alternate symbols in a string, (2) extraction of a word P 
from its Q-diluted form, that is, from P t Q , (3) truncation of P or Q from the 
f-pair PfQ. In such cases, substitution formulas of the following types could be 

used: FI: ^0* and F2: F*t ^ *t 

We illustrate the use of these formulas by means of the following examples : 

Let us consider the alphabets -4, = Cab} ; 3B = C*);8 = CTeO} and the 
words P = abba and Q = bab from J,, such that abbalbab is from v4,U3B. 

EXAhPLE 32.7.1. Normal algorithm for truncating the right *-term in a *-pair 


,>f' 


REX. 


Formula number 

0|U > UO (U € U) (0) 

0*U > 0* (i) 

* ^ ( 2 ) 

0 h (3) 

► 0 (4) 


Now, • abbaXbab h- Oabbalcbab I- aObbaIrbab h abCtoailbab |- 

abbOaXbab h abbaO«bab h abbaOXab h abbaOXb h 
abbaOX t- abbaD h* abba 

EXAhFLE 3.2 .7 .2. Normal algorithm for truncating the left *-term in a *-pai.r 




LEX 


Formula number 

ru k tlT ((L € v4) (0) 

€*t ► *T (f € J,) (i) 

T* ► »Te (2) 


1 


(3) 
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T ^ (4) 

e — (5) 

k r (6) 

Now, JT : abbal^bab |— rabbai^bab (- aTbbaXbab abrbaJfbab f- 

abbTa*bab I- abbarlbab h abbaSrSbab f- abb*Tebab |- 
ab*T&bab h a*T$bab I- *T©bab h T%>ab h ©bab {-• bab 
Exclusively with the techniques of transposition, annihilatiwi and injection 
[sc&sec on 221 , we can construct a scheme for any desired normal algoriti a. In 
what follows, we provide some more techniques which will be of use in cwistructing 
normal algorithms for signal processing purposes. 

3.3 ADVANCED STRING MANIPULATING TECHNIQUES 
3.3.1 CYCLIC PERMUTATIONS IN ANY MiSIRED FACTOR OF A WCRD : 

In general, a rearrangement c a word P = €i€ 2 -?m ^ where €£,...,€m are 
generic variables in an alphabet, is a t«>rd P = F, F. ...F; where iii 2 ...im is a 
permutation of 1234.. jn. The class of all possible permutations of a word is known 
as the rearrangement class of P, of which cyclic oermutations of P form a subset 
[223. A cyclic permutation in a word can be achieved by means of modified versions 
of shifting algorithms or jf*"® [ Subsection 3.2 3. 

The technique proposed here is concerned with the problem of ccMTstrt*rting a 
normal algorithm that causes cyclic permutations in any desired factor of a given 
string. We bring out details of this technique with the help of an exatwle. 

Let v4 be an alphabet and P = ^1^2 ••^i^i+l^i+2^i+3 --^'»' ® where 

15i:im are generic variables in J,. Let us say that we are interested in having 
a cyclic permutation in the factor €i€i+i€^i+ 2 ^i +3 of the word P. To (to this, we 
proceed in two steps: (1) we inject two auxiliary s^^nbols □ and f in P, in such a 
way that the desired factor becomes a (CHO-term [Definition 3.1.33 and (2) we 
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introduce certain transposition-type 3 formulas in the scheme of the shifting 
algorithm so that the algorithm is made available only to the (0*)-term. Note that 
the auxiliary symbols 0 and * act here as delimiters to the desired factor. 

For example, the following scheme is a modified version of and it is 

applicable only to a (0*>-term : 

Formula number 

iifr ^ FFiti € J,) <0) 

(1) 

( 2 ) 

(3) 

(4) 

(5) 

Let v4 = {a b} , P = abab and P* = aObalb 

Now, aDba»b I- aaObalb f- a«Ctoa*b h aDaba*b J- 

aObaaXb i- aOsaalb h oaOsaaXb f- a^Obaafb h 
aOftbaaXb h aOxtaailb h- aOMiaaXb h aObaPf b l- 
aOarb^b h- aOabXb 

Although we has/« evolved the algorithm with reference to a specific 

factor of a given word, it may be seen that it is of a perfectly general nature. To 
be more precise, given any word and a factor of it to be cyclically permuted, the 
formulas of can be used. 

Sometimes, we come across a situation in which a particular factor of a 
multifactored string has to be cyclically permuted. For example, let us consider a 
word P from an alphabet J., consisting of m factors; P * P^P 2 ..Pi -Pm- We may be 
interested in getting the i^^ factor of the string P, to be cyclically permuted. In 
order to do this, we take the following steps; (1) Firstly, we inject m distir»t 
delimiters dj^,d 2 ,d 3 ,...,dj,...,dni in such a way that the given string P is expressed 
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as the shuffle Pld = PidiP 2«‘2 -^i-iPi'^i ”Pmdm- <2) Next, Me introduce i-1 
substitution formulas of transposition-type 3, in the scheme of the modified 
shifting algorithm so that the remodified algorithm is made available only to 

the (d|_j^,dj)-term of Pld. 

Now, th»e following scheme causes cyclic permutation in the <d|_^,d|>-term 

of a shuffle PJd = P^dj^P 2 d 2 ...dj.^Pidj..Pmdm. 




CPF. 


ti^r 


ad 4 


erti 

d^a 


Formula ncmber 
( 0 ) 

< 1 ) 


ad; 


ail 

aa 


ila 


r 


r 


(i) 

a+1) 

a+2) 

(i+3) 


h a a+4) 

CPF* 

Now, Jf ( P t d ) = P^dj^ ‘^i-lPi^^i -Pm^m > where P^' is the cyclic permutation 

of the factor P^ . 

We now move on to a further generalization of the shifting algorithm, using 
which, factors of a given word are separately and simultaneously cyclic permuted. 


3.3.2 CYCLIC PERMUTATIONS IN ALL THE FACTORS OF A WORD : 

Given a factored string P from an alphabet J,, P = Pj^P 2 ...Pin; our problem is to 
carry out cyclic permutations of all the m factors separately. In orcter to this, we 
first of all rewrite the word P as a ^-diluted string [Definition 3.1.73. This gives 
us the string Pt* = Pj^*P 2 *...*Pm- We know that cyclic permutation in a string is 
carried out by a shift operator F right adjoined to the string. So, in order to 
carry out cyclic permutations in all the factors of the given word P, that is, in 
every *-term of the string Pt* , our next step is to inject the shift operator F in 
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PT* as follows: P^r*P 2 r* r*Pmr. Now the following scheme carries out 

cyclic permutations in all *-terms of Pt* , one by one from the left, sequentially. 

Formula nunber 


(afir i iir^a € ,>l> (C») 

aiir — > tirot <oi) 

0(1 > ail0 (02) 

eta ^ j8 (03) 

00 ) r (04) 

Fa ^ r (CS) 

Ffi f iir ( 06 ) 

0a » 0 (07) 

r*a ^ *j8 (08) 

0iffi k 0W (09) 

r — ( 10 ) 

► a (11) 

Now let us consider an alphabet vi = Ca b} , a word P = abba and PT* = ab*ba 


JC' 


FCP. 


ab*ba aab*ba h eeetabXba I- |Sab*ba (- oajSbXba h aaab)S*ba h- 


aaabj8*|3ba H aaabj3*abj3a f- aaab)3*abaaj8 h- aaaabj3*abaa/3 |- 
i3aetbi3*abaa^ I- aa0ab0i(abaa0 f- ai0b0Xabaa0 h 
aaab00)fabaa0 h aaabr^abaa0 h abraa^abaa0 h 
bfaaalabaajS h bFaafabaajS h baFa*abetaj8 H- 
baF*abaaj3 ba^0baa0 h baMab0aa0 h ba^ab0a0 h 
ba^abaa00 h ba*abaaF h baletaFba I- ba*aFetba I- ba*aFba h 
balabFa {-• bafab 

The techniques discussed so far (i.e., transposition, annihilation, injection and 
cyclic permutation), enable us to construct SLtostitution formulas required for 
different symbol manipulations in words from the union of a basic alphabet J., an 
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alphabet 8 of auxiliary symbols and an alphabet ® of delimiters. Now, with a formal 
characterization of SLtostitution formulas, our study of string manipulating 
techniques would be complete. 

3.3.3 PATTERN MATCHING TECHNIQUE 

In general, the operation of examining strings of symbols from an alphabet, for 
the occurrence of specific strings knc»ai as patterns is defined as pattern 
matching Cl?]. As per this definition, a si.A)stitution formula, is a prescription for 
attem matching and substitution. In other words, the left part of a substitution 
formula, which is a specific pattern, is examined for its occurrence in a given 
string of symbols and replaced by the right part of the formula, the value of the 
pattern. So, a normal algorithm over an alphabet J., is a prescription for 
systematically examining a set of strings from the free monoid A for the 
occLrrence of a finite number of patterns and substituting them with their values. 

Let us consider a basic alphabet A, an alphabet consisting of delimiters 
and an alphabet 8 consisting of auxiliary symbols. Now, patterns are those strings 

X 

from (»^U3>U8) which are used as left parts of various substitution formulas 
constructed over the union of these disjoint alphabets. We are interested in two 
kinds of patterns that we call (1) Siiwle patterns and <2) Complex patterns. A 
simple pattern is a string either from A or (,AU3» that is used as left part of 

X 

a substitution formula. A complex pattern is a string from (^U3)U8) containing 
at least one symbol from 8 , and which is used as left part of a substitution 
formula . Simple and Complex patterns are further divided into regular simple 
patterns, irregular simple patterns, regular complex patterns and irregular 
complex patterns. Regular patterns are those, whose constructions are governed at 
least by any one of the rules of the string manipulating techniques discussed so 
far. Irregular patterns are special patterns of both simple and complex tosses, 
whose constructions are not governed by any rule, but are used as left parts of 
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certain substitution formulas. 

Me now proceed to verify, in the next section, the usefulness of these string 
manipulating techniques, by actually constructing normal algorithms for carrying 
out the traditional signal processing operations of cyclic shifting and linear 
convolution of nonnegative integer sequences. 



SECTION 4 


REALIZATION OF CERTAIN hORMAL-ALGORITmiC SIGNAL PROCESSING OPERATIONS 

In this section, we demonstrate the use of the string manipulating techniques 
of section-3, in nonnumerical signal processing. First, we construct a normal 
algorithm for carrying out cyclic shifting in a string of arbitrary length. Next, we 
outline a general method for i instructing normal algorithmic systems for signal 
processing operations on symbolic sequences in general. As an illustration, we 
then construct a normal algorithmic system for carrying out linear convolution of 
nonnegative integer sequences. 

4.1 CYCLIC SHIFTING BY MEANS OF A NORMAL ALGORITHM 

When the normal algorithm Jf*"® [Example 3.2.4Z3 is applied to a word, say P 
from an alphabet A, the ending of P is shifted to its left by the shift operator F 
which gets annihilated after the shifting is over. As we shall see later, there are 
situations in which we make use of F not only as a left shift operator, but also as 
a part of certain patterns to be substituted by their values. In order to do this, 
there has to be a provision in the scheme of Jf^® for bringing F back to the right 
of the word whose ending is left shifted. 

With this purpose in mind, the following scheme of has been constructed 

cs 

over v4UCa /S F). Jf causes one cyclic shift (left shift) in any string of 
arbitrary length, in the free monoid «4 . 

Formula number 

FaiiF ) jtiFFa (€, € ^) (0) 

afir ) jtiFa 


( 1 ) 
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CM 

m 

ra 

rti 

0a 

r 


aU0 

0 

r 

r 

Mr 

0 


a 


( 2 ) 

<3) 

(4) 

(5) 

( 6 ) 

(7) 

( 8 ) 
(9) 


Let us consider, for instance, the alphabets = CO 1} and 8 = (a j3 D and 

cs 

apply Jt to a word OtO from 
cs 

Now, Jf •• Formula Elementary 


nLflrfser 


9 

9 

3 

2 

2 

2 

2 

9 

3 
2 
7 
2 
7 
2 

7 
2 

4 
0 
0 
0 
i 

5 

6 

5 

6 

5 

6 
5 

8 


transformations 


K3D f- < Input string ) 

aK3D 

aaKDiO 

iSiOiO 

ai^OD 

al«0j3D 

aktOaiiSO 

ala0ak(0j8 

aa\aOa\aO0 

0iaOaiaO0 

al0aOalaO0 

al0OalaO0 

a\aO0a\aO0 

a\aO0laO0 

a\aOa\0aO0 

a\aOa\0O0 

a\aOa\aD00 

aiaOaUnOr 

alaQaOria 

ak(OrO«la 

aOriaOaia 

OralaOcKla 

OrkiOala 

OfTaOala 

OTOala 

0H3r«la 

Gloria 

OlOra 

oior 

OK)l 4— < Output string ) 
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causes one cyclic shift in the word DO after 29 elementary 
transformations such that DD becomes ODI. In fact, the number of transformations 
that a word P of length n undergoes when is applied to it for one cyclic 

shift, can be computed with the help of the rule a+(n-i)d where a*!! and d=6. 

It can be observed that the process of applying if°^ tc a word P ccmes to an 
end after a single cyclic shift, on the application of the 8^ substitution formula 
of the scheme. So, if we require n consecutive cyclic shifts in a word P, ,>r has 
to be applied consecutively (n-1) ncanber of times to the intermediate strings. But, 
this can be done in a different manner. Let us replace the terminal formula F ►• 

of the scheme of by the simple formula F ^ and make use of Theorem 2.3 .3 .4 

cs 

in achieving a control over the number of cyclic shifts. Now, the scheme of Jf 

CCS 

with the above modification is labelled as Jf where the acronym ccs stands for 
Consecutii/e Cyclic Shifts. Tt® generality of the scheme of has been verified 

by implementing it in a personal computer, using FORTRAN facility . 

For example, if we use the interactive FCBRTRAN program CYSl-FT [Appendix A.il 
corresponding to the scheme of Jf for carrying out two cyclic shifts in a word 
P ss ODOtllOil from the alphabet = CO 1) , then the output file would contain the 
following ■ 

GIVE THE NO. OF CHARACTERS IN THE INPUT STRING: 

10 

GIVE THE IhFUT STRING: 

C Press <return> only after tt« complete string is given 3 
ODOlliOII 

SPECIFY NUMBER OF CYCLIC SHIFTS: 


2 
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Formula Elementary 

number transformations 


9 

9 

3 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

9 

3 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 

4 
0 
0 
0 
0 
0 
0 
0 
0 
0 
1 

5 

6 

5 

6 


003111011 Qnput string) 
oOODIIIOil 
aaODOIIDII 
jSOODIIDII 
<£0)810011011 
aOcc 1)80011011 
<£0ai<£0)30ll0it 
<£0<£i<£0<£0)8ll0i{ 
aO<£ kcOccOa 1)8 i O i i 
<£0<£ l<£0<£0a l<£ 1)8 O I i 
aOa faO«i " ; k£ ke i)80 it 
<£0a l(£0<£0<£ k£ l<£ k£0)8 1 1 
<£0a l<£0<£0a l<£ la \aQa 1$ I 
<£0a I<£0a0<£ loc la kKO<£ la 1)3 
a<£Oa laOaOa la la laOa la 1)3 
^Oa laOaOa la la laOa la 1)8 
aO)3a laOaOa ia la loOa la 1)8 
<£0)8 laOaOa la la laOa la 1)8 
aOa \0aOaOa la la laOa la 
<£0a I)80a0a la la laOa la 1)8 
aOa Ia0)8a0a la la loOa la 1)3 
aOa Ia0)80a la la laOa la 1)8 
<£0a Ia0a0)8a la la laOa la 1)3 
aOa Ia0a0)8 la la laOa la 18 
aOa laOoOa l)3a la laOa la 18 
aOa laOaOa 18 la laOa la 18 
aOa laOaOa la 18a laOa la 18 
aOa laOaOa la 18 laOa la 18 
<£0a laOaOa la la I)3a0a la 18 
oOa loOaOa la la l)30a la 18 
aOa laOaOa la la Ia08a la 18 
aOa laOaOa la la Ia08 la 18 
aOa laOaOa la la laOa D3a 18 
oOa laOaOa la la laOa 18 18 
aOa laOaOa la la loOa la 188 
aOa laOaOa la la laOa la IT 
aOa laOaOa la la laOa IF la 
aOa laOaOa la la la ITOa la 
aOa Ia0<£0a la la or laOa la 
aOa laOaOa la IT la laOa la 
aOa laOaOa IF la la laOa la 
<£0a laOa IFOa la la loOa la 
aOa la IFOoOa la la kicOa la 
aOa IF laOaOa la la laOa la 
a IFOa laOoOa la la laOa la 
IFaOa Ia0<£0a la la loOa la 
IFOa laOoOa la la laOa la 
OFa laOaOa la la laOa la 
OF laOaOa la la loOa la 
O IFaOaOa la la l<£Oa la 
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8 

9 

9 

3 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

9 

3 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 
7 
2 

4 
0 
0 
0 


KD irOccOcc la la laOa la 

D DPaOa la la laOa la 

10 OrOa la la laOa ia 

10 DOPa la la iaOa la 

O 03P la la laOa la 

D DO IPa la laOa la 

DDOIPkxIoOala 

DDOIIPalaOala 

DDOiriaOala 

DDOIliPaOala 

DDOlllPOala 

DDOIIIOPala 

DDOIIDPIa 

DDOIIDIPa 

DDOIIDiP 

DDOIIDI f- C First cyclic shift is over after 

a D DO 1 1 10 1 65 elementary transformations 3 

aaDDOIIDI 

6DIOOIIIOI 

al/30D0IIDI 

alaOeiOOIIDI 

akxOali^llDI 

aiaOataOjSOIIDI 

a loDa ia0a06 1 1 D I 

a laOa loOaOa IjSIDI 

a ioOa laOoOa la !jS D I 

a iaOa iccOoOa la la IjSO I 

a loOa laOoOa la la iaO/3 1 

a laOa laOaOa la la hxOa 10 

aa laOa laOaOalala laOa 10 

0 laOa laOaOa la la laOa 10 

a l0aOa loOaOa la la laOa 10 

a 100a loOaOa la la laOa 10 

a laO0a laOaOa la la loOa 10 

a iaO0 laOoOa la la laOa 10 

a laOa l0aOaOa la la laOa 10 

a laOa l0OaOa la la laOa 10 

a loOa laO0aOa la la laOa 10 

a laOa laO0Oa la la laOa 10 

a laOa laOaO0a la la laOa 10 

a laOa laOaO0 la la laOa 10 

a laOa laOaOa 10a la laOa 10 

a laOa laOaOa 10 la laOa 10 

a laOa laOoOa la 10a laOa 10 

a laOa laOaOa la 10 laOa 10 

a laOa laOaOa la la l0aOa 10 

a laOa laOaOa la la 100a 10 

a laOa laOaOa la la laO0a 10 

a laOa laOoOa la la laO0 10 

a kxOa laOaOa la la laOa 100 

a laOa laOaOa la la kxOa IP 

a laOa laOaOa la la la IPOa 

a laOa laOoOa la la IP loOa 

a laOa laOoOa la IP la laOa 
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0 

0 

0 

0 

0 

0 

1 

5 

6 

5 

6 

5 

6 

5 

6 

5 

6 

5 

6 

5 

6 

5 

6 

5 

6 
5 
8 


a laOa laOaOa IF la la laOa 
<x iaOa laOa IFOa la la kxOa 
a laOa la IFOaOa la la loOa 
a laOa IT laOaOa la la iaOa 
a fa irOa loOaOa la la laOa 
a IF laOa laOaOa la la loOa 
IFa laOa loOaOa la la laOa 
IF laOa laOaOa la la laOa 
I IFaOa laOaOa la la laOa 
1 IFOa laOaOa la la laOa 
IDFaiaOoOalalalaOa 
I tOF laOaOa la la laOa 
to IF aOaOa la la laOa 
I O IFOaOa la la kxOa 
I O lOFaOa la la loOa 
lOOFOalalalaOa 
IIOIOOFalalaloOa 
lOIOOFkxIalaOa 
IIOOOIFalalaOa 
IIOOOIFIalaOa 
lOOOIIFalaOa 
lOIOOIIFIaOa 
IIOOOIIIFaOa 
lOIOOIIIFOa 
lODOIIOFa 
lOOOIlOF 

llOiOOIIO ♦— [Second cyclic shift is over after 

130 elementary transformations 3 


4.2 HOW TO REALIZE A CONSTRUCTIVE SIGNAL PROCESSING OPERATION ? 


Here, the term constructive signal processing refers to the sytnbolic 
processing of signals by normal algorittKns, irrespective of the fact t'rfnether 
sample values of signals are expressed as numbers or words. 

DEFINITION 4.2.1 

By a constructi^'e signal processing system, we mean an ordered pair <K, X>, 

x 

where, 9? represents a normal algorithm and X is a subset of <»4U3)) that is 
recognized by ». vt is a basic alphabet in which signals are represented and ID is 
an alphabet of delimiters. 

Now, we outline a general n^thod for constructing normal algorithms for 
implementing binary operations between numerical data sequences. 
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Let us consider two numerical data sequences p<n) and cKn) of M and N data 
samples respectively. Let r(n) be the result of an arithmetic operation, say • 
between D(n) and q(n), that is, Kn) = p(n>*q(n). Our interest is to carry out this 
operation symbolically, by means of a normal algorithm. We proceed as follows. 

Firstly, we code the data samples of p<n) and q(n) as words from a suitable 
alphabet A. so that the data sequences p<n) and q(n) are expressed respectively as 
Ptdp = PidpP2dp...Pjdp...dpP„ , i^iiM and QTdq = QidqQ 2 dq...Q^dq...dqGlN , 
where dp and dq are two diff _ 'ent delimiters from the alc^abet 3). Next, we express 
these coded strings as a *-pair (PTdpjlfCQTdq) , where the symbol * is a delimiter 
from the alphabet 3). 

Now, the *-pair is to be manipulated in such a way that the resulting string, 
say Rtdp , corresponds to the output r(n). A normal algorithm meant for this 
purpose would cause the following sequence of string manipulations. 

Let dj^(PTdp>^t<QTdq) = dj,Pj^dp...dpPj.,^*Qj^dq...dqQ|^ frrfiere, d|^ is another delimiter, 
dj^ is used to identify Pj^ at any stage of the manipulation. Firstly, the *-pair 
pattern consisting of the right most factor P|^ of Ptdp and the left most factor 
of QTdq is substituted by its value . Rj^j^ is the result of a suitable 

manipulation of Pm and Qj^ , and it corresponds to the value of the intended 
operation between the last sample of the first data sequence p<n) and the first 
sample of the second data sequence q(n). Now Pj.^ is shifted to the left end such 
that the resulting string would be of the form; 

PM‘^Pl‘^-PM-i^*®lPMl‘^d-*^dQN- 

By assigning a value dpXQj^dp to the pattern dp*Q^ , a delimiter dp is injected in 
the first dq-term, which is used here in order to identify Rj^j^ at any stage of the 
manipulation. Now, dp is shifted to the left end such that the resulting string 
would be of the form: 


‘^pPpl^^kP • ■ dqQiv^ ■ 
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The above procedure is repeated for the *-pair pattern Pm-I*®! such that ttw 
resulting string would be of the form : 

We shall repeat this procedu^ till we arrive at a siring which would be of 
the form : 

P idp . . Q £dcR2 N ■ 

Now, we shall make use of the delimiter d|^ in two ways ■' (i) dj^ is used as a 
type-3 annihilator such that is erased by assigning the ^ due dj^* to the 
pattern and (ii) dj^ is allowed to inject a right shift operator S into the 

right *-term when either a value dj^fSdc is assigned to the pattern ci|^*dc , or a 
value , l^i^M, ii^j^N is assigned to the pattern ol|^*Rij or a value dj^Mdr 

is assigned to the pattern d|^lfdq. The moment S is introcfejced, R^^ , dc and dr will 
be shifted to the right. This is repeated till all the M gerrerated values are 
shifted to the right end. Now, the delimiter d^, is shifted to the left such that the 
resulting string would be of the form ; 

d|^P ^dp . . .dpP^^Q2*^Q • • i • • .SdpSR 

This procedure is repeated for all the remaining (N-l> dq-terms of QTdq after 
which Rdp together with the delimiters d|^ , * and the right shift operator S are 
erased by means of a type-3 and a type-2 annihilation fctf'mulas. The resulting 
string RTdr corresponds to the result of the operation between the two coded 
strings of p(n) and q(n) and it would be of the form •• 

'^MN^cR<M-i)N<^c - dcRiN«^rRM(N-l)‘=*cR(M.ixN-l)‘^c 

Now, the values of Ry ; are decoded such that the output Kn) 

due to the (^ration beti^en p<n) and q(n) , is obtained. 

Note that the operation ■ between p(n) and q(n) is carried out by manipulating 
the corresponding oocted *-pair with the help of left shifing, right shifting, 
transposition, annihilation and pattern matching SLfcstitution formulas. 
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4.3 LIhCAR CONVOLUTION OF NONf'CGATIVE INTEGER ^QUENCES 
BY A CCW4STRUCTIVE SYSTEM 

In M, a general method as to how one can construct a normal algorithmuc 
signal processing system was outlined. In what follows, we provide a specific 
example of one way of constructing a normal algorithmic system, that carries 

out the operation of linear convolution of nonnegative integer sequences of 
arbitrary lengths, i^ie shall maku use of thffi string manipulating techniques of 
section 3 in obtaining our constructive system . 

Let us consider two discrete time signals x(n) and y(n) of samples M and N 
respectively, which are to be convolved with the help of normal algorithms. Let the 
convolved output be z(n) of M+N-1 samples. Now, the required system is 

constructed as per the following steps: 

STEP 1 

We need the following alphabets for the construction of 9 ?°°^ : 
vto = CO I}; 3)i = C , 3 ; 3)2 = C03 ; 3)3 = C*3 

S = CabajSrfiSffUtf). 

3) = 3)^U3)2LI3)3 j *^1.1 ~ ,AoL)3)j^ i '^iZ ~ v4.oLI3)2 i *^13 “ '^il^'^iZ ' 

Ao = CO 1 2 3 4 5 6 7 8 93 . = ^i3U3)3 ; 

Further, we consider the sets N = Cx I x is a natural number in the traditional 
sense 3 and S = Cx I x is a nonnegative integer sequence 3- 

We also need the following subsets of certain free monoids CTable 4.3.13 for 
con. 


the construction of K 



46 


COO 

Table 4.3.1: Subsets recognized by 9t 


■ 

Free monoids 

Subsets 

sample elements 
of the subsets 

i 

Ac* 

N = £x 1 X is a word (natural 
nutdber) from Aq.) 

4 

2 

(AqUH^)* 

S = Cx 1 X is a nonnegative 
integer sequence.} 

2,4,6,8,12 

3 


Xo= Cx 1 xs=0 or 1^ ; i2:l) 

lilt 

4 

.4 * 

'^11 

Xii={x 1 x=P or Pt, ; PCXq) 

MMli 

5 

.4 * 

X^ 2 =Cx 1 x=P or PTD ; PCXq} 

IDIIIOIIII 

6 

4 . * 

4,13 

y 

X'^ 3 =£x 1 x€Xj^i or 

1,11,111 or 
iOillOIIII 

7 

4,13 

X"i 3 =£x 1 x=PTO ; P€Xj;p 

1,11,11011,11011,1 

8 

1 

4 * 

*^14 

Xi 4 = Cx 1 x=OP*Q ; PeX^^; 

01,11,111*101101111 or 

, j 


Q€Xi 2 or X "^3 

□ 1,11, 1*11,1101,11, III 


STEP 2 

Firstly, we code the data samples of x(n) and y<n) from N over the alphabet Aq 
in the following manner: The number □ is represented as the string 0 and the 
number 1 is represented as the string I from the alphabet Aq. The number 2 is 
represented as the string il and the number 3 is coded as the string III . fri this 
fashion, any non-negative integer can be coded in the alphabet w4o. Since 
convolution is a binary operation, we express the coded strings of x<n) and y(n) as 
a I-pair over the union of the alphabets Ao , 3)^^ , 3)2 ®3 *-pair is 

of the form 0 Xt,*Yt 0 = 0 Xj^,X 2 ,...,Xj,...,XM*Yi 0 Y 20 ... OYj-O ... DY^^ where Xj , (l^i^M) 
and Yj , (l£j:iN) are coded strings from Aq corresponding to the data samples of 
x(n) and y(n) respectively. We require three normal algorithms in order to obtain 
the above *-pair: (i) that transforms x(n) into Xt, (ii) that transforms y(n) 
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into YTO and (iii) Jf* that forms the *-pair OXt,*YTO . For brevity, we shall call the 
string OXT,*YTO Precom^olution String. 

STEP 3 

Convolution is basically a multiplication operation. Firstly, let us consider 
the following normal algorithm which allows one way of carrying out the 

multiplication operation between two coded strings of nonnegative integers that 
are expressed as a *-pair. has been constructed over • 

j^mul. Substitution formulas F.jnmula number 

a I > iba (0) 

bl ^ tb (1) 

0*1 > 0 * ( 2 ) 

i*0 ^ *0 (3) 


1*1 \ *al (4) 

*1 i * (5) 



* 


( 8 ) 


For example let us consider a *-p>air 111*11 of strings from ^ and apply to it. 


jijjnul. 


Formula number 


Elementary transformations 


(4) 

( 0 ) 

( 0 ) 

( 1 ) 

(4) 

( 0 ) 

( 0 ) 

(i) 

(4) 
(D) 
( 0 ) 
(i) 

(5) 
<5) 

( 6 ) 


111*11 f- Onput String ) 

U*ali 

ti*fba! 

II* lb Iba 

IHIflIbba 

Hlalibba 

l*lbabba 

l*lblbabba 

Bilibbabba 

*altt}babba 

*babbabba 

*lbbabbabba 

*llbbabbabba 

*bbabbabba 

*bbabbabba 

fbbbbabba 
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(6) 

fbbbbbba 

(6) 

«bbbbbb 

(7) 

IXbbbbb 

(7) 

tlfbbbb 

(7) 

IliXbbb 

(7) 

iiliibb 

(7) 

llllllfb 

(7) 

illilll 

(8) 

mill f- 


( Output String ) 

The string II I 111 corresponds to the number 6 which is the product of 3 and 2 . 


Now, the multiplication operation can be carried out in the *-pair • 


OXt,*YtO □Xj^,X2,...,Xi,...,XM*Yi0Y20 ... OYjO ... OY^ 

by means of a normal algorithm which makes use of the technique of 
PP 

K is one such normal algorithm constructed over contains 

certain pattern substitutions and certain already known algorithms. The scheme of 
PP 

Jf is given below : [Note; {i) tl, i € Aq. (ii) The acronyms TPT stands for 
Transposition Type, AT for Annihilation Type, PTS for Pattern Substitution and 


SPL for Special ti#}e. A special type formula is constructed by making use of 
known techniques as per the need, (iii) LINCON is the FORTRAN program for 
implementing [Appendix A .2 3] 


SI .No. Substitution Formulas Formula Type of Remarks 

number the 

as labelled formula 
in program 
( LINCON ) 


(00) jtlofr ► fFita 

(01) 0a€r ► €r0a 

(02) iianr — t nrua 

(03) aor — ^ or« 

(04) aer — ^ era 

( 05 ) 0Ur ^ ail0 

(06) CM > 0 

(07) 00 > r 

(08) r<t — > r 

(09) rp , — ^jtzr 

(10) ro — ►or 

(11) 0a ► 0 

(12) 0D ► a0|3 

(13) p*u ► *i/ 

(14) 0*i/ ► 

(15) Up ► V 


(00) 

TPT-4 

(01) 

TPT-4 

(02) 

TPT-4 

(03) 

TPT-4 

(04) 

TPT-4 

(05) 

SPL 

(06) 

SPL 

(07) 

SPL 

(08) 

AT-2 

(09) 

TPT-3 

(10) 

TPT-3 

(11) 

AT-2 

(12) 

SPL 

(13) 

AT-3 

(14) 

AT-3 

(15) 

AT-2 


The formulas (00) to 
(12), (59) and (60) 
form a modified 
scheme of 


Formulas (13), (14) 
and (15) fcM'm the 
scheme of 



(17) 

(18) 



(19) i/0 ) Di/ 

( 20 ) t/U, y Uu 

(21) Scr y S 

( 22 ) re — y r 

(23) 0*1 — y oe*oi 

(24) 0*0 y 0*a0 

(25) ,* yM. 

(26) 1*0 y l*a0 

(27) al y Iba 

(28) SbU y ilSb 

(29) aOa ) aaO 

(30) aOO y aO 

(31) aa ) a 

(32) bl y lb 

(33) SbO )OSb 

(34) Jba y aSb 

CS) Sbb y bSb 

(36) Sbcr ^o-Sb 

(37) SW6 

(38) £3*50 y 0*0 

(39) SuB y DSu 

(40) StiCF y trSfl 

(41) Spa y aSp 

(42) Spb y bSp 

(43) SDp y PSD 

(44) 5CEI )05D 

(45) trp^ y ^(tP 

(46) D* I ► 0* 

(47) 0*0 y 0* 

(48) D*ba y D*5b 

(49) 0*b y 0*51 


(50) D*a y 0*5 

(51) 0 * 0 - ► 0*5 

(52) r*0 ► *50 


(53) r*, — y *(7, 

(54) r*b — y *5b 

(55) r*l y *al 

(56) r*o — y * 0-0 

(57) r*aO y *OaO 


(17) 

AT-2 

(18) 

composition 
of TPT-3 
and letter 
substitution 

(19) 

TPT-3 

(20) 

TPT-3 

(21) 

AT-2 

(22) 

AT-2 

(23) 

PTS 

(24) 

PTS 

(25) 

PTS 

(26) 

PTS 

(27) 

SPL 

(28) 

TPT-4 

(29) 

TPT-3 

(30) 

AT-1 

(31) 

AT-1 

(32) 

TPT-3 

(33) 

TPT-4 

(34) 

TPT-4 

(35) 

TPT-4 

(36) 

TPT-4 

(37) 

TPT-4 

(38) 

AT-3 

(39) 

TPT-4 

(40) 

TPT-4 

(41) 

TPT-4 

(42) 

TPT-4 

(43) 

TPT-4 

(44) 

TPT-4 

(45) 

TPT-4 

(46) 

AT-3 

(47) 

AT-3 

(48) 

PTS 

(49) 

composition 
of AT-3 and 
letter subs- 
titution 

(50) 

composition 
of AT-3 and 
PTS 

(51) 

composition 
of AT-3 and 
PTS 

(52) 

composition 
of AT-3 and 
PTS 

(53) 

PTS 

(54) 

PTS 

(55) 

PTS 

(56) 

PTS 

(57) 

PTS 


Formulas (28) 
(33) to (37) , 

(39) to (44) form 
the scheme of 


Formulas (46), 
(47), (49), (50) 
and (51) form 
the scheme of 

j^REX 
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(58) 

ms - 

— ♦ *i/5 

(58) 

composition 
of AT-3 and 
PTS 

(59) 

i/ — 

— 4- 

(59) 

AT-1 

(60) 

— 

—4 a 

(60) 

SPL 


PP 

^ transforms the ore-convolution string DXT,*YT0 into another string of the 
form (PTO)"^ which is the inverse of PTO [Definition 2.3.43. The string PTO = 

- - called the partial product string, 

and every 0-term of PtO corresponds to the partial product component of the 
multiplication of y(n) by x(n). 

For example, let us consider two data sequences x(n> = i, 0 and y{n) = 2, 1 and 
apply to the corresponding pre-convolution string 01,0*101. After 269 

elementary transformations we would obtain the string 0,03,1! which is the inverse 
of the partial product string PtO. [NOTE; We have made use of the program LlhOON 
in obtaining the required string! 


FORMULA ELEMENTARY 

NUMBER TRANSFORMATIONS Remarks 

The pre-convolution Data sequences to be con- 
string is; volved: x<n)=l,0 & y(n>=2,l 

01 , 0*1101 

23 0l,0j3*010l > Product of 0 and 2 is obtained 

60 aOl,O0*OlK31 in the coded form as 0 

60 aaDI,0jS*011DI 

6 601,0)3*01101 
12 aD6IX>6*0ll0l 

5 «D« 16,06*0 110 1 
5 a0«la,606*0i!0l 
5 cc0aiaA066*0IDI 

7 aDal«A»0r*011DI 
0 aDala 0 r,a* 0 !lDl 
0 a 0 a 0 ria,a* 0 ll 0 l 

0 a0r0ala,a*0IIDI I ♦,;*l 

4 0ra0«la,a*0IOI 

8 0r0aia,a*01l01 

10 00 r«fa,a* 0 llDl 

8 0Dria,a*0il01 

9 0Dra,a*0fDI 

8 ooirAx*oiiai 

9 0DI4’«*0I!01 
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8 ooi,r*oiDi > 

56 OOI,»aOllOl 
25 OOI,)3*,ffOIDi 
45 (XH,j8»,krOOI 
45 OOI,i8*,lkrOni 
60 aC«l,6*,U<rODI 
60 aa00l,^*,llcr00l 

6 0OOI^*,lkrOOI 
5 a0/30l,^*,llcr00l 

i2 a0a06l,^*,ila00l 
5 «OaOal/3,j3*,llcrOOI 

5 aO«Oala,/3i3*,llo-ODl 

7 «OaOalaX»,llcrOOI 
0 a0a0a,rfa*,llcrCK]l 
0 aOaJ'OaJa*,llo-OOI 
0 aj’0«0ala*,llff00l 

4 ,r<xOaOaia;^,llcrOOi 

8 J'OaOala*,lfo-ODl 

9 Xir«0al«*,ll<T00l 

8 ^r0ala*,ll(70DI 

10 ^0r«la*,flcr0DI 

8 130n«*,lla00l 

9 lDOr«*JkJ-OOI 
8 IXliriEWIcrOQl 
53 ,OOI*o-,lto-(XII 
45 ,OOI*lo-,lffOOI 
45 ^OI*llcr;CrOOI 
60 a,OOI*li£7,ffOOI 
60 aa,OOI*flo-,o-OOI 

6 iS,CMDI*llcr,crODI 

5 a,/300«Elk7,(700l 
5 a,t60<30l*llo-,o-00l 

12 a,aOaO^I*llo-^OOi 

5 a/KOocOaijSf Ii(7,(r00l 
60 aa,ffiOaOalj8Xil(r,(7'OOI 

6 j8,aCkcOaij3Iili7AOOI 
5 aj3flt0£t0aJj3*ii«7^00l 

11 a,/30«0aljS*llff,cr00f 
5 a;^0)8aClali3Xll(7,a00l 

11 a,a0)30aljS*llcr,(TCCII 

12 a,aOangiam\\fy,f^On\ 

11 a,aOaD/3lj0*llcr,crODI 

5 a^CkxDaliSjS^licritrOOl 

7 «A*OaDar*llo-,(rOOI 
0 a^OairOafllo-^OOl 
0 a/KirOaOaXllo’^COi 
0 air,a0a0a*ll(7^0DI 
4 ira,aOaOaX I hTfCrOD [ 

8 r,aOaDa*llcr,<yODI 

9 l,raOana*llcr,o-OOI 

8 I,r0«0a*llo-,<700l 

9 l,0r«0a*lkr^00l 

8 I,or0a*llcr,or00l 

10 llDOra*llff^QOI 


The coded string of 0 left shifted 




8 i,oor*ii(7^oo» 

55 IXO*alky^OOI 
27 l,00*lbalo-,«r0DI 

27 f/3D*lblbacr^0DI 

32 l,00*ltbbaa-,a(XII 
46 lX)0*fc>bacr,o-OOI 

46 l,OD*bbao-,crODi > 

49 l,00*Jbbao-,(TtXll 

35 lOO*bSbacr,crOOI 
34 l,00*baSbcr,(r00l 

36 WO*baffSb,o-OOI 

28 l^*bao-,5b(rOai 
36 I^Cfbao-^JbODI 
28 I^*baa-^05b0l 

33 l,00*ba(r,o-OOSbl 
28 WO*bacr^OOI5b 
48 l^*Sb(r,o-OOI5b 
36 l^*tJ-Sb,o-OOISb 
28 IXK]*o-,Sbo-OOI5b 

36 l,00»ff,(rSb00iSb 
28 WO*tr,o-OSbOISb 
33 l^*cr, (7005b ISb 
28 IX)0*(7A700ISb5b 
51 I,00*5,cr0015b5b 
40 llDD*o-S,OOISb5b 

37 llD0*(705X!l5b5b 
39 l,CX]*t7005,l5b5b 
37 IX)0*<700iS,5b5b 
51 ll30*fiOOI5,SbSb 
39 l,0D*050iS,SbSb 

37 1,00*0 IS05,5b5b > 

60 a 1,00*0 l505,5bSb 
60 aa 1,00*0 1505,5b5b 
6 /3l,00*0i505,SbSb 
5 al/3,00*0l50S,5b5b 
5 al«j30a*DIS05,SbSb 

5 ala,aOj0O*OI5O5,Sb5b 
12 alaA0a0j3*0l505,5b5b 
60 aal(x,aOaOj8*OI505,Sb5b 

6 i8l«,«0a0i3*DI50S,5b5b 
5 alj3a,aOaOj3*OI50S,5b5b 

11 alj3A0«0)3*0IS05,5bSb 
5 ala,6a0a0/3*0IS05,5bSb 
11 tflaj80aOj3*OI505,5b5b 
5 ala,a0/3e60i3*0IS0S,5b5b 

11 alaAOj80j3*OISOS,5b5b 

12 alaA0a0i3)3*0l50S,5b5b 

7 alaA0a0r*01S05,5bSb 
0 cela,aOrOa*OI505,5b5b 
0 alaDr,aOa*OI505,5b5b 
0 aDria,aO«*OI505,Sb5b 
3 0ralaA0a*0lfi05,SbSb 

8 0ria,<x0a*DIS05,Sb5b 

9 Dra,a0a*0IS05,5b5b 


Product o-f 1 and 2 is detained 
in the coded form as bb. 


Coded string (Corresponding 
to the first partial product 
component right shifted. 
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5 aj300i*la,a'0S0S0S,Sb5b 
5 aAOjSOI*l£?,crOSOSOS,5b5b 
12 a,aOaOjei*lo-rfr050SOS^bSb 

5 a.aOaOal|8*la,o-OSOS05^bSb 
60 aa,aOaOal6*lo'»o'OS0505,Sb5b 

6 i8,a0a0alj8*la^0S0505^bSb 
5 a,/3a0a0alj3*l(7,(70S0S0S,5bSb 

11 a,j80aOal/3*lo-^OSCDSOS,SbSb 
5 aAOi8aO«l)8*la,cr050SOS,SbSb 

1 1 a,aOma liS* l<?,cr0S0S05,Jb5b 

12 a,a0«0/3ai|8*lcrAr0SE3S0S,Sb5b 
11 a,aOaDj3lj8*l(7,£rOSOSOS,5bSb 

5 a,<»0a0ali8i3*l(r,cr0S[K05,5bSb 

7 a,«0a0<y!r*i(7,cr0S0S05,5bSb 
0 a,aOa ir sT a* k7,cr05050S^bSb 
0 «/cir0a0a*lcr,cr050S05,5bSb 
0 airA0a0«*l(r,c70S050S,Sb5b 

4 ira,a0ct0a*lff,c70S0S0S^b5b 

8 irAO«Oa*lcr,o-OS0505^b5b 

9 l,raOaOa*lo-,<7050SOS^b5b 

8 l,r0aOa*I(7-^05OSOS^5b 

9 llDraDa*lo',(r0S0505^b 
8 l,OrOa*lo-,tr050SOS,SbSb 

10 l,O0r«*lcr^O5OS0S,SbSb 
8 l,OOr*lo-,o-05[]JOS^b5b 

55 l,00*alcr,or050SOS,SbSb 

27 llDa*toatJ-,tr0S0S05,SbSb 

46 ll30*bacr,cr0S0505,Sb5b > 

48 l,00*5bcr,ffOSDSOS,SbSb 
36 W30*(7Sb,cr0S0S0S,SbSb 

28 l,CX]»o-^bcrOS0505^bSb 

36 l,00*ff,cr5b0S0S05^b 
28 1,00*0-, cr0Sb50505,Sb5b 
51 l,00*5,c705bS050S,Sb5b 
40 ll30*o-S,QSb50S05,Sb5b 

37 l,00*o-05,Sb50505,5b5b 
51 IXO*505,5bS0S0S,SbSb 
60 al,00*S0S,SbS0S0S,SbSb 
60 <»al,00*S0S,Sb50S0S,5bSb 

6 /3l,00*50fi,SbS0505,Sb5b 

5 al6,00*S0S,5b50S05,SbSb 
5 al«,j30D*S0S,Sb5CKO5,SbSb 

5 ala,a0j80*S05,SbJ0S0S,5bSb 
12 ala,a0a0(3*S05,SbS0S05,SbSb 
60 aala,a0(K0/3*S0S,SbS0S05,5b5b 

6 i8la,«0a0ie*S05,Sb50S05,Sb5b 
5 al0a,aOaO6*SOS,SbSO5OS,5b5b 

11 alj8,a0aD6»S0J,SbS0«05,5b5b 
5 ala,M0a0<3*S0S,Jb50S05,5bSb 

11 al«,/30a0j3*S0S,Sb5060S,SbSb 
5 ala,a0j3a0^»S05,SbS0S0S,5bSb 

11 alaAO/3O0*SO5,Sb5OSO5,5bSb 

12 ala,a0a0e)3*505,Sb5050S,5bSb 

7 ala,a0a0r*S05,5b50S0S,5b5b 


Procfcjct of 1 and 1 is obtained 
in the coded form as b 
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0 ala,a0r0a*J05,Sb5O50«,5b5b 
0 alaOr,a0a»5OS,5bSO505,SbSb 
0 aOria,aOa»5OS^b«O50S^b5b 
3 0rala,a0«*50S,5b5050S,«bSb 

8 OriaA0a*S05,SbfiDSO«^bSb 

9 0ira,«0a*505,SbSDS0S^b5b 

8 □ir,a0a*S05,5bS0S0S^bSb 

9 0l,ra0a»S0S,Sb5D50S;SbSb 

8 0l,r0a*S05,Sb50S0S^Sb 

9 0i^r«*50S^bS0505^bSb 
8 DI^3rf505^b50S05,5bSb 

58 0l,0*/^S0S^b5DSC35^bSb 
13 0!,*i;S0S,SbS0S0S,SbSb 
13 0I*i/50S^bSDS05^bSb 

13 0*i^S05^b50S05,SbSb 

14 *i/S05,SbS0S05,SbSb 

15 z/S0S^SD505,5bSb > Left excision of the *-pair 

16 iKD£^b50S0S,Sb5b has been carried out 

20 0i/S,SbS0S0S,Sb5b 

16 0i/,SbJ050S,Sb5b 
20 0,i/SbS0S0S,5bSb 
16 0,i/b50S05,5bSb 

18 0,li/S0S05,Sb5b 
16 0,li/0505,5bSb 

19 O.Di'JOS.SbSb 
16 0,Ei/05,5bSb 

20 O.DOi^S^bSb 
16 0,l00i/^bSb 
20 0,l00,i/5bSb 
16 0,l00w/bSb 
18 0,l00,li/Sb 
16 0,00, li/b 

18 0,D0,lli/ 

THE INVERSE OF THE PARTIAL PRODUCT STRING IS: 

59 0,00,11 


The no. of elementary transformations is : 269 

The complexity of symbol manipulation in terms of elementary transformations 

PP 

for the multiplication of any two nonnegative integers say i and j by Jf , is 


determined by the following rules : 

PP 

I NOTE : Jf has to be applied only to the *-pair I#T where 1 and J are the coded 
strings from „4o corresponding to the numbers i and j . Let t^^ be the number of 
elementary transformations of IlcJ after which the string coresponding to the 


product of i and j is obtained. 1 
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RU.E i •• too = 43 
RULE 2 : = 39 

RULE 3 : r NOTE : tgi # t^g 3 

RULE 4 : For all i > 1, t^g = t^.^jg + (12i+16) 

RULE 5 ; For all j > 1, toj = ^j-1) ^ 

RULE 6 : For all i > 0, = l^g + la-l) 

RULE 7 ; For all i and j >1, + (3i+l) 

The following table contains certain values of t^j , ( i, j ^ 8 ). 

PP 

Table 4.3^: Complexity of svpnbol manipulation due to Jf in multiplying two 
nonnegative integers 











STEP 4 
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As mentioned in STEP 3, tt« string PtO = ^ii^2L’ 

»Pm 2*^ *^iN'^2N' called the partial product string, and 

every O-term of PtO corresponds to the partial product component of the 
multiplication of y<n) by x<n>. In the traditional signal processing, the linear or 
aperiodic convolution of x(n) of M samples and y(n) of N samples is computed by 

M+N-i 


z(n) 


^ y{k)x(n-k) 


k=0 


such that the convolved output z(n) consists of M+N-1 samples. Let us take for 
example, x(n> = 1,2,3 and y<n) = 2,3,4 and compute their convolution directly. 

y(n) 



Partial product components; < 2,4,6 >, < 3,6,3 >, 8 


The convolved output z(n) = 



12 > 

12 . 


From the above computation, we observe that the first one element of the first 
component is taken as the first convolved output sample; two elements, 4 from the 
first component and 3 from the second component are adcted to get the second 
sample; three elements, 6 from the first component, 6 from the second component 
and 4 from the third component are added to get the third sample; two elements, 9 
from the second coti^onent and 8 from the third component are added to get the 
fourth sample; and the remaining one element from the third component is taken as 
the fifth sample of the sequence z(n). Now, the ordered sequence of numbers that 
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are marked above with underline, can be seen to be of a palindrome type. Let us 
denote it by L. Then, L in this case is 1,2,3,2,1. 

In general, three types of such palindrome sequences can be formed in the 
case of linear convolution of data sequences of M and N samples. 

a) 1,2,3, (n-l)/i,(n-l) ,3,2,1 for H=N=n 

(ii) 1,2,3, ,(M-l),M,Mn n(M-l>,...,3Ai f or M < N 

N-M+1 times 

Qii) 1,2,3, ,(N-1),N,N>I, n(N-l),...,L 2,1 f or N < M 

M-N+1 times 

On the basis of this simple observation, we develop in what follows, a normal 

CA -i 

algorithm Jf which chooses appropriate elements from (PTO) and add them so 

that a string ZT, = obtained. Each ,-term of Zt, corresponds 

to a sanwjle of the convolved output z(n) of x(n) and »:Kn). 

Two nonnegative integers, that is, words frcrni ^ i«#iich are separated by a 

delimiter could be added just by removing the delimiter itself. For example, the 

representations of two integers 3 and 4 over the alphabet v4o can be added using 

+ 

the following scheme Jf constructed over . 

N 


+ 


Jf : 


Formula ntanber 

N 




0* — y 

(0) 


*0 — y 

<1) 


* \ ( 2 ) 

— y- (3) 

: 111*1111 h IIIIIM (-• Iffilll 

N 

However, this algorithm fails in adding selected number representations in a 
string such as in the case of adding , P^2 ^13 string : 

± 2 ^ 22 ^ 3 :^ 13 ^ 23^33 


In such cases, the following prescription would be of use in carrying out 
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specific number of Choose and Add derations in arbitrarily long sequerxies 


similar to the one given above : 

PRESCRIPTION FOR CHOOSE AND ADD OPERATIONS 

(i) Let us consider a string PTO where each 0-term is a ,-system of words P^j 
from v^ro- Let us assume that there are t number of O-terms in PtO and that our 
purpose is to choose the first ,-term of every 0-term ard add them. 

(ii) Let L be the word from Aq corresponding to the number t. Now we shall 

form the *-pair L*PtO and apply tht following scheme constructed over 

,/toU3)U8 : 

•W' : Formula rHjHi±>er 


SjUO 

SjUF 

Sp,. 

mp 

Bl, 

*, 

vvD 

up 

u, 

uU, 

uUp 

5 


DSp 

esp 

,sp 

mpe 

^Sp 

t/Hu 

pu 

,u 

□ 


(P € »^£j) 
(6 € Aq) 


( 00 ) 

(01) 

(02) 

(03) 

(04) 

(05) 

(06) 

(07) 

(08) 

(09) 

( 10 ) 
( 11 ) 
( 12 ) 
(13) 


Now, let PtD rsP^ j^,P2^j.--/Pfu|j^DPj^2'P22'‘"'^M2^"^®^lN'^2N''"'^MN ' ^ number 

cs 

of O-terms where, t=sM+N-l and apply to the *-pair: 

•••••• •*Pil'P2r”'*^M1^12'"'^H2^--^lN'--'^ 

t times 
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Dub to the forn«jlas <03) and <04) of JT®* the first ,-term is shifted to 

the right, letter by letter, so that the resulting string would be of the form: 



t-i times 

Now, the repetitive application of the formula (05) to the above string injects 
t-i number of choose operators u in the right *-term which in ttm get distributed 
to the remaining (t-1) 0-terms with the help of formulas (07), (08) and (09) of the 
scheme, as shown below : 

^^2L’ • ■ 13' ■ • • • '^^^IN' • ^ 1 i 

Now, with the help of formula (11), that is, i/OfJL jtiOSjti the first ,-term of 

each of the remaining (t-i) 0-terms is chosen one by one and shifted to right. 
After completing the shifting of all the chosen , -terms , the shift operator 5 is 
erased with the help of formula (12), and the required string of the following form 

P21/-..^M1^22' -'^M2^23' -^ ■®^2N' -'*^MN ^1N^1(N-1) "^12^11 ^ obtained. Now, the 
factor PiN^KH-i) --^ 12^11 string corresponding to the addition of the first 

,-term of all the 0- terms of the string PTO. 

o a CA 

A modified version of JT is the following scheme >r which carries out the 
required type of Choose and Add operations in an inverse partial product string. 
SCHEME OF 

Type of Remarks 

the 

formula 

TPT-4 
TPT-4 
TPT-4 
TPT-4 


SlJ4o. Substitution Formula 

formulas number 

as labelled 
in Program 
(LINCON) 


(00) 


-4 ^rua 

(61) 

(01) 

oafr — ► eroa 

(62) 

(02) 

jtiaor — 

UTlla 

(63) 

(03) 

aor > ora 

(64) 
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(04) 

(05) 

(06) 

(07) 

(08) 


afr ► fPa 

Sil ) ap,0 


(14) 

(15) 

(16) 

(17) 

(18) 

(19) 

(20) 

(21) 

( 22 ) 

(23) 

(24) 

(25) 

(26) 

(27) 

(28) 

(29) 

(30) 


aa ■ 

ra- 


o*e 

es 
ew • 
SjtiO - 
S/if - 
I*, - 
Mm - 

,*C«) - 
i/W - 
i/ifU — 

,*/i - 

00 — 
10 — 
01 — 
Uil 


* j8 

r 

r 


(09) 

TU- 

-4 UT 

(10) 

TU— 

-4 or 

(11) 

$a — 

~4 0 

(12) 

00 — 

-4 ccD0 

(13) 

/i*e — 



-4 *e 
-4 e 

-4 /i© 
-4 OS/i 
-4 fS/1 
■4 l*U) 
4,*a) 
4,*i/ 

4 Ui/ 

4 i/Di/ 

♦ ^*,/i 
K 
► 0 
► I 

I 

iLU 


(65) 

TPT-4 

(66) 

SPL 

(67) 

SPL 

(68) 


(69) 

AT-2 

(70) 

TPT-3 

(71) 

TPT-3 

(72) 

AT-2 

(73) 

SPL 

(74) 

AT-3 

(75) 

AT-3 

(76) 

AT-2 

(77) 

AT-2 

(78) 

TPT-3 

(79) 

TPT-4 

(80) 

TPT-4 

(81) 

PTS 

(82) 

PTS 

(83) 

PTS 

(84) 

TPT-3 

(85) 

TPT-3 

(86) 

PTS 

(87) 

SPL 

(88) 

AT-1 

(89) 

AT-1 

(90) 

AT-1 

(91) 

TPT-3 
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(31) 

//O, — 

-f 0 

(32) 

composition 
of two 
formulas of 
AT-1 

otherwise 
known as 
'Excising 
formula" 

(32) 

vDn — 

-4 i/OSlA 

(93) 

SPL 


(33) 

r*<j — 

-4*,u 

(94) 

PTS 


(34) 

r*o — 

-)* 

(95) 

composition 



(35) 

r*, 

— f*5. 

(96) 

(36) 

r*iu, 



(sr?) 

(37) 

r*s 

— > *e 

(98) 

(38) 

rm 


(39) 

(39) 

e 

' — 

(100) 

(40) 


> a 

(101) 


of two 
formulas of 
AT-i 

PTS 

PTS 

PTS 

PTS 

AT-1 

SPL 


.PP 


It was shorn in STEP 3, Uial JT transforms the st-pair 0JX)*1S3I into the 

inverse partial product string (PTD)~* = 0,D0,l!. By means of a normal algorithm 
PL 

Jf , (whose scheme is given below) we shall obtain the *-pair whose left 3lf-term is 
the corresponding palindrome string Ml, I left delimited by 0 and the right *-lerm is 
the inverse partial product string 0,100,11 . 




PL. 


Formula number 
* < 0 ) 

L < L = MM ) (1) 

0 ( 2 ) 


Jf' 


PL. 


XA 


0,100,11 h *0,100,11 I- 1,11,1*0,00,11 h* 0MM*0,D0,II 
Now, K'-"' transforms 01,11,1*0,00,1! into the string ZT, = 11,1,0 where Zt, 
corresponds to the convolved output sequence 2 (n) = 2,1,0. CtOTE: We have made use 
of the program LINCON in obtaining all the 306 elementary transformations which 
are given below! 


Jf' 


CA. 


0MM*0,I00,11 
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LINCON : 

ADJOIN PALINDROME STRING TO THE PARTIAL PRODUCT 
STRING, CHOOSE AND ADD: 

0I,IM»0,BX),II 4- t 0,100,11 H 01,11,1*0,00,11 3 

lOi aOMI, 1*0,00,11 

lOi aaOl, 11,1*0,00,11 

67 601,11,1*0,00,11 

73 «061, 11,1*0,00,11 

66 aDal6,li,l*0,D0,ll 

66 aOai«,6ll, 1*0,00,1! 

66 aOalaAl6l,l*0,DO,H 

66 aOaiaAlal6,l*0, 00,11 

66 a0ala,alal«,6l*0,00,ll 

66 aDc(la,alala,ccl6*0,00,ll 

lOi <xaOai<xA la IffA 16*0, 00,11 

67 60a 1«A la la,a 16*0, 00,11 

73 a06a!a,a la la,a 16*0, 00,11 

72 a06la,a la la,a 16*0, 00,11 

66 aOai6a,a la ia,a 16*0, 00,11 

72 a0al6,alala,al6*0,00,ll 

66 a0ala,6alala,al6*0,O0,ll 

72 a0ala,6lala,al6*0,00,ll 

66 a0ala,ai6ala,al6*0,00,li 

72 a0ala,al61a,al6*0,00,ll 

66 a0ala,alal6a,al6*0,00,ll 

72 a0ala,alal6,al6*0,00,ll 

66 a0ala,alala,6al6*0,ID0,ll 

72 a0ala,alalaj8l6*0,00,ll 

66 a0ala,aiala/Kl66*0,O0,il 

68 a0ala,a!ala,air*0,00,ll 

61 a0ala,alalair,a*0,00,ll 

61 a0ala,alairia,a*0,00,ll 

61 a0ala,airiala,a*0,00,l! 

61 a0alair,alalaA*0,O0,lt 

61 aC]airia,alala,a*0,O0,ll 

61 air0ala,alala,a*0,00,ll 

65 ira0ala,alalaA*0,O0,ll 

68 irOa la,a la la,a*0, OO, 1 i 

71 0rala,alala,a*0,00,ll 

69 Dria,alala,a*0,D0,ll 

70 Dra,alala,a*0,O0,ll 

69 0ir,alala,a*0,00,ll 

70 0l,ralala,a*0,00,ll 

69 DIJ’lala,a*0,O0,ll 

70 Ol,irala,a*0, 00,11 

69 Dl,ria,a*0,O0,ll 

70 DI,ira,a*0,O0,ll 

69 Dl,lir,a*0, 00,11 

70 DI,ll,ra*0,O0,ll 

69 01,11^*0,00,11 

97 OI,II,*60,DO,1I 

80 01,11,*, 6000,11 
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80 DUI, *,15000, II 

70 101,11,*, 10500,11 

80 I0I,II,*,ID050,II 

80 DI,II,*,C10,50II 

80 DI,II,*,I00,I50I 

80 DU I,*, DO, 1 150 

86 DI,IIJ3*„00,II50 

87 DI,II,/3*,D0,IIS0 

101 «D 1,1 1.6*, DO, 1 150 

101 aaDI,ll,6*,D0,ll50 

67 6D1,I1,6*,D0,II50 

66 al6OUIj8*,D0,ll5O 

73 ala06l,ll,6*,D0,ll50 

66 alaOfel6,ll,6*,DO.II50 

66 alaDakcMM.nOMi * 

66 alaDala,al6l,6»,D0,ll50 

66 «l«0al«Alal6,6*,D0,ll50 

66 alaOal«,alala,66*,D0,ll50 

68 ala0«l<x,a;lccla,r*,D0,ll50 

61 alaDala,ala,ria*,DO,ll50 

61 alaDala,aXlala*,DO,IISO 

61 ala0alaX,atai«*,D0,ll50 

61 ala;0a,ria,al«>«*,D0,ii5O 

61 <xta,r0ala,aiafa*,D0,ll50 

61 a,na0ala,al«la*,D0,II50 

65 J'ci!ta0aia,alala*,D0,ll50 

69 ,ri«0a(a,alala*,D0,ll50 

70 ,iraD«tffi,alala*,D0,ii50 

69 .irDala,alala*,D0,ll50 

71 ,IDrala,alala*,D0,ll50 

69 ,DriaAlal«*,D0,ll60 

70 ,Dira,«lala*,D0,ll50 

69 ,Dr,alaIa*,HDO,ll50 

70 ,IDI,ral«te*,D0,ll50 

69 .DI4'lal«*,D0,ll50 

70 ,IOI,ir«l«*,DO,ll50 

69 ,DUri«*,DO,IISO 

70 ,DUira*,D0,ll50 

69 ,Dl,lir*,D0,ll50 

96 ,101,11*5,100,1150 

80 ,DMI*I5, 00,1150 

79 ,DI, 11*105,0, 1150 

80 ,Di,H*l005„li50 

80 ,DI,II*D0,5,IIS0 

80 ,101,11*100,15,150 

80 ,01,11*100,115,50 

101 a, 101,11*100,115,50 

101 cca.DI, II* 00,115,50 

67 j3, 01,11*100,115,50 

66 a,/3IOI,ll*D0,ll5,5O 

66 a,ali80l,ll*IOO,ll5,50 

73 a,alaO0l,ll*IOO,ll5,5O 

66 a,ala0alj3,ll*ID0,ll5,50 

66 a,ala0aia,i3li*D0,ll5,50 
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66 a,alaOala,al0l*DO,ll5,SO 

66 a,ai<xCkxi<x,alcc 161 00,115,50 

iOl aa,alaD«la,alal6*IOO,ll5,50 

67 6Ala0«la,«l«l6*D0,ll5,50 

66 a,6o^ia0ciclcc,alal6<l00,ll5,50 

72 a,6la0a}a,alal6*00,ll5,50 

66 i^aOa \a/t la I6f 03, 1 15,50 

72 a,ai60ala,alal6*IOO,li5,5D 

73 a,ala06aia,ala!6%l00,il5,50 

72 a,ala06ia,al«!6*IOO,IIS,50 

66 a/);la0aI6a>alai6^t00,li5,50 

72 a,alaOa!6,a la 16* 00,1 15,50 

66 a,aloiOala,6<xlo(l6*IOO,li5,50 

72 a,ala0ala,6lal6*O0,IIS,50 

66 a,alaOala,a 16a 16* 100, 115,50 

72 a,alaOala,al6l6*IOO,ll5,50 

66 a,alaOala,alal66*IOO,il5,50 

68 a,alaOala,a lair* 100, 115,50 

61 a,alaOala,air la* 00,115,50 

61 a,alaOa la ir,a la* 00,1 15,50 

61 a,ala0airia,ala*00,ll5,50 

61 a,alair0ala,ala*00,ll5,50 

61 a,airia0ala,ala*00,ll5,50 

61 air,ala0ala,ala*00,ll5,50 

65 Ira,aia0ala,ala*i00,ll5,50 

69 ir,alaOala,a la* DO, 115,50 

70 ljralaDala,a la* 100, 115,50 

69 Ijra0ala,ala*00,ll5,50 

70 l,raDala,ala* 100,115,50 

69 l,irDala,ala* 00,115,50 

71 l,Orala,ala*O0, 115,50 

69 I, or la,a la* DO, 1 15,50 

70 l,Dira,ala*00,ll5,50 

69 l,Dr,ala* 00,115,50 

70 I, Dlja la* 00,1 15,50 

69 I,0l,na*00,ll5,50 

70 I,0l,ra*00,ll5,50 

69 1,01, ir*O0, 115,50 

99 I,0l,r*500,ll5,50 

79 !, 10 J,ir*a5 10, 115,50 

80 I,l0l,ir*005l,ll5,50 

80 l,DI,ir*00,5lll5,50 

80 1 , 101 , ir*00,ISII5,50 

80 1,01,000,11515,50 

95 1,01,1*0,11515,50 

101 al,OI,l*0, 11515,50 
101 aal,DI,l*0,IISI5,50 

67 61,01,1*0,11515,50 

66 al6,OM*0,115l5,50 

66 ala,6iai,l*0,ll5l5,50 

66 ala,al60l, 1*0, 11515,50 

73 ala,alaD6M*0,ll5l5,50 

66 ala,ala0ai6,l*0,ll5i5,50 

66 ala,ala0ala,6l*0,ll5l5,50 
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66 alOrAMialaAmO.miSJSO 

lOi aala,alaO«laAl6*OillSI5,SO 

67 6 la,alaDala,a 16*0,11515,50 

66 al6<x>ato0ala;,<Kl6*0,lt5i5,50 

72 al6/tl«0ala,al6*0,ll5l5,50 

66 akx,6<(l(x0<xia,ai6*0,ll5i5,50 

72 ala,6la0ala,al6*0,IISIS,50 

66 al«,al6a0«ia,«el6*0,ll5l5,50 

72 al«,«li8Dala,al6*0,ll5l5,50 

73 ala,ala06ala,al6*0,llS15,50 

72 ala,«la06l«,al6*0,li5l5,50 

66 ccia,alaDal6<x,a 16*0, 115 15,50 

72 ala,ala0al6,al6*0,ll5l5,50 

66 ala,ala0«la,6al6*0,IIS15,S0 

72 ala, ala0ala,6l6*0, 11515,50 

66 ala,afa0ala,al66*0,li5l5,50 

68 a la,ala0ala,air*0, 11515,50 

61 ala,ala0alair,a*0,ll5l5,50 

61 ala,ala0airiaA*0,ll515,50 

61 alaAlar0ala,a*0,ll5l5,50 

61 ala,airia0ala,a*0,ll51S,50 

61 alair,alaDala,a*0,ll5l5,50 

61 airia,ala0ala,a*0,ll5l5,50 

65 irala,alaDala,a*0,ll5IS,5Q 

69 ria,ala0ala,a*0,ll5l5410 

70 ira,ala0ala,a*0,H515,50 

69 Iir,ala0ala,a*0,ll5l5,50 

70 ll,rala0ala,a*0,llSI5,50 

69 IIJ’la0ala,a*0,llSI5,50 

70 Il,ra0ala,a*0,ll5l5,50 

69 ll,ir*paia,a*0,ll5IS,S0 

7l' ll,Drala,a*0,ll5l5,50 

69 ll,10ria,a*0,H5l5,S0 

70 Il,l0ira,a*0,ll5l5,50 

69 ll,IOir,a*0,ll5l5,SO 

70 Il,101,ra*0,ll5l5,50 

69 II, I0l,r*0, 11515,50 

97 II,DI,*50,II6I5,50 

80 II,D1,*,50IISI5,50 

80 Il,i*pl,*,l50l5l5,50 

80 l!,DI, *,1150515, 50 

86 Il,l0i,6*„ll505l5,50 

87 II,IDI,6*,II505I5,50 

101 all,IOI,6*, 1150515,50 

101 aall,10l,6*, 1150515,50 

67 6II,IOI,6*,IIS05IS,SO 

66 a 16 1, D 1,6*, 1 1505 15,50 

66 alal6,IOI,6*,ll505l5,50 

66 alala,6IOI,6*,li506IS,50 

66 alala,al60l,6*,ll505l5,50 

73 alala,ala06IJS*,IIS05l5,50 

66 alala,ala0al6,6*Ji505l5,50 

66 alala,ala0ala,66*,li505l5,50 

68 alala,alaOala,r*,IIS05l5,SO 
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6i alala,alaDa,na*,IIS0SI5,ra 

61 alal«,ala,rO«la*,IIJQSlS ,$0 

61 «lala,a,riaDala*,ll50SIS^0 

61 ala!«,r,al«Oala»,IISO«fS,SO 

61 alaJ’la,ala0ala*JI505l5,50 

61 a,rialaAla0«la*,ll505IS,S0 

65 ,r«lala,ala0ala*,ll505l5,50 

69 XlaiaAlaOaia*,llSOSI5,SO 

70 ,irala,al«0ala*,tlS0515,ra 

69 ,ria.alaOalaf,IIJOSIS,SO 

70 ,lira,alaO(xla*, 1150515, SO 

69 ,ir,«l«Oala*, 1150515,50 

70 ,ll,rala0ala*,1150515,50 

69 ,ll,riaOala*, 1150515,50 

70 ,ll,r«0ala*,ll50516,50 

69 ,ll,rOal«*, 1150515,50 

71 ,ll,Drala*, 1150515,50 

69 ,ll,Oria*, 1150515,50 

70 ,li,Dira*,11505l5,50 

69 ,11,00,1150515,50 

96 ,11,01*5,1150515,50 

80 ,11,01*15,150515,50 

80 ,11,01*115,50515,50 

101 a,ll,DI* 115,50515,50 

101 a«, 11,01*115,50515,50 

67 All, 01*115,50515,50 

66 a,)311,Dl*il5,50515,50 

66 a, aliSl, 01*115,50515,50 

66 a,alalAOl*115,50S15,50 

66 a, a la la,i3 0 1* 1 15,505 15,50 

66 a,alala,ali8DI*ll5,50515,50 

73 a,a la la,a Ia06 1* 1 15,505 15,50 

66 a,alala,ala0alj3*!15,505i5,50 

101 aa,a la la,aiaOa 10* 115,505 15,50 

67 0,a la la,alaOa 10* 115,505 15,50 

66 a,0a la la,alaOa 10* 115,505 15,50 

72 a,0 la la,alaOa 10* 115,505 15,50 

66 a,al0ala,alaOal0*115,5O515,5O 

72 a,al01a,alaOal0*ll5,5O515,SO 

66 a,a la 10a,alaOa 10* 115,505 15,50 

72 a,a la 10,alaOa 10* 115,505 15,50 

66 a,a la la,0alaOa 10* 115,505 15,50 

72 a,afala,01aOal0*ll5,5OS15,5O 

66 a,alala,al0aOal0*il5,5O5l5,5O 

72 a,alala,al0Dol0*li5,5O5l5,5O 

73 a,a la la,alaO0a 10* 115,505 15,50 

72 a,alala,alaO010*ll5,5OSlS,5O 

66 a, a, la ta,a laOa 100* 1 15,505 15,50 

68 a,a la la,alaOa IT* 115,505 15,50 

61 a,alalaAlair0a*li5,5O515,50 

61 a,a la la,airiaOa* 115,505 15,50 

61 a,alalair,ala0a*IIS,50SI5,50 

61 a,a la IT la,alaOa* 115,505 15,50 

61 a,a IT la Ia,ala0a* 115,505 15,50 
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61 air,alato,aiaOa*IIS,SOSlS^O 

65 ira,«i«la/claOa* 1 15,505 IS,SO 

69 irAlal«AlaOa*ll5,505i5,50 

70 I,ratola,ala0a*ll5,50515,50 

69 I,ri«la,«la0a» 1 15,505 15,50 

70 i,iralaAla0a*ll5,505l5,S0 

69 l,ri«AlaO«*IIS, 50515,50 

70 I,l!ra,a!a0a*ll5,50515,50 

69 I,ir,ala0a*ll5,505i5,50 

70 l,lljralaDa*lJ5,505i5,50 

69 I,ll,ri«0«*ll5,505l5,50 

70 I,ll,ira0a*ll5,505l5,50 

69 I,li,r0a* 115,50515,50 

71 I,lt,iara*ll5, 50515,50 

69 l,fl,0'*H5,505l5,50 

99 15115,50515,50 

80 i,ll,IOr*l5l5,50515,50 

99 l,ll,Dr*5l5l5,505i5,50 

98 1,11,0*61515,50515,50 

75 1,11,1*61515,50515,50 

74 1,11, *61515,50515,50 

74 1,11*61515,50515,50 

74 1,1*61515,50515,50 

74 1,*61515,50515,50 

74 1*61515,50515,50 

74 *61515,50515,50 

76 61515,50515,50 

78 16515,50515,50 

77 1615,50515,50 

78 1165,50515,50 

77 116,50515,50 

78 11,650515,50 

77 11,60515,50 

78 11,06515,50 

77 11,0615,50 

78 11,0165,50 

77 11,016,50 

78 11,01,650 

77 11,01,60 

78 11,01,06 

90 11,1,06 

100 11,1,0 


The string Zt, = 11,1,0 is obtained after 306 elementary transformations . 

STEP 5 

One can construct another normal algorithm over the alphabet ^ 

that decodes Zt, into the convolved output z(n). 11,113 ) = 2,1,0 

So far, we outlined the construction details of certain normal algorithms 
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which form the system In what follows, we indicate the type of msos 

corresponding to those normal algorithms and show how they are combined to form 
the system [Table 4.3.3 and Fig .4 .3. 13 

For convenience, we recall from STEP 1, the alphabets over the union of which 
jjjcon been constructed : 

= {O D ; 3)^ = 0}; »2 = '■ ®3 = and 8 = { a b « j3 F S e cr u i/ }. 

3) = > “^11 " i ^12 * ,AqU3)2 * ^^13 “ f 

'^iA = ; Ao = CO 1 2 3 4 5 6 7 8 9). 

Let us also consider N = Cx I x is a natural number in the traditional sense.} 
and S = Cx I X is a non-negative integer sequence}. 

Table 4.3.3: Types of maps corresponding to the normal algorithms that 
constitute 


SI. 

No. 

Normal 

algorithm 

Alphabet over 
which constructed 

Ti#)e of the 
map 

Function 



AoUv4 

S— 

forms , -diluted 
strings from 
representing 
natural number 
sequences. 

2 


Aq 

S— fXi2 

forms 0-diluted 
strings from 
representing 
natural number 
seauerK>es. 

3 


any alphabet A 


transforms any 
string to the 
same string. 

1 

>f* 

•^14 

>^'13— + ^14 

forms the pre- 
convolution 
string. 

5 


“^14 

Xi4_+ X«i3 

transfcMTDs pre- 
convolution contd. 


i 
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string into 
inverse partial 
product string. 

6 


v4i4 

^"l3 ^ ^14 

forms the *-pair 
whose left *- 
term is the 
suitable palin- 
drome string 
with □ as the 
left delimiter 
and whose right 
*-term is the 
inverse partial 
product string. 


JfCA 

1 

1 

I 

v4i4 

Xi4 > 

transforms the 
f-pair formed 
by into a 

string corres- 
ponding to the 
convolved out- 
put sequence. 

8 

JfDC 

J 

AoUxAj^ 

Xii— fS 

decodes the 

string due to 

#“into the 

corresponding 

non-negative 

integer 

sequence. 


The block diagram of the operational scheme of the constructive system 
is shown in figure 4.3.1. 



FIGURE 4.3.1: Operational scheme of 
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SECTION 5 


STUDY CF NORMAL ALGORITHMIC SIGNAL PROCESSING SYSTEMS 
IN TERMS OF FORMAL LANGUAGES GEhCRATED BY A GRAf^R 

The purpose of this section is to introduce a formal language for the study 
of constructive ( normal algorithmic ) signal processing systems. The motivation 
for such a study is provided by the fact that a constructive signal processing 
system SR over an alphabet A, is in essence a mapping that recognizes a subset X 
(i.e., a language) of the free monoid and maps it onto anotl^r subset Y of words 

jt 

in . With X and Y as the input and output signal spaces, SR admits of being 
treated as a system described by a grammar and also as an automaton. 

5.1 FORMAL REPRESENTATION CF SIGNALS AND SYSTEMS OVER ALPHABETS 
The starting point of our study is the formal represent^ility of words and 
algor ithans over alphabets by Elementary Formal Systems ( EFS ) of Smullyan E333. 

An elementary formal system over an alphabet A is defined as a set of 
alphabets. A, Y', P and f, together with a set of axioms. is a given alphabet 
whose words are the basic elements of interest in the EFS. Y' is an alphabet of 
two types of variables, the first ti^e consisting of proper y'ariables that range 

over the free semigroup A'*’, and the other type consisting of improper variables 

¥ 

that range over the free monoid A . ? is an alphabet of predicates, each of which 
assigned with a unique positive integer called its degree. T is an alphabet 
containing two symbols called the implication sign and punctuation sign. The set of 
axioms of the system are strings from the above distinct alphabets and are known 
as uell formed formulas (wff). 

Any string of symbols from the alphabet is known as a term generally 
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denoted by t, of the system. By an atomic formula F, we mean a string from the 

alphabet «4.UV'Uy of the form ptjLt 2 tm where p is a predicate of degree m and 

tj[» t 2 j > tm are terms. A well formed formula is defined as a word Ft-» in 

v'tUY'UyU/ where FT-4 = F^-f F 2 -t -+ Fj-» -4 Fn and F^ : (i^i^n) is an 

atomic formula. Fj^, F 2 , , F; , Fpj_£ are called as premises ana ^n ss the 

conclusion. Any atomic formula is also a wff which means that it is by itself a 
premiss and the conclusion. If all the variables of a wff are substituted by 
strings from A,, then the resulting string is known as an instance of the wff. A 
variable-free wff is known as a sentence. A theorem of an EFS is either an axiom 
or a string which is derivable from the set of axioms of the EFS with the help of 
the following rules of inference ; 

(i) Instantiation : Substitution of strings from for variables. 

(ii) Modus Ponens : The rule by which a formula can be inferred from 

another atomic formula. 

Let p be a predicate of degree n from ? and let W be a set of n-tuples of 

X. 

words from A . Then, we say that p represents W if 0 x^X 2 . .Xn is provable in the 
EFS over sA. for every n-tuple Xj^X 2 ...Xn in W. 

As an illustration of an EFS, let us consider the alphabet = { 0 I } in 
which the natural number system can be formally represented as shown below. The 
relevant alphabets for the EFS in this case are- 
al ,Ao = C 0 I } 
ai) *r = C X } 

aii) y = C N 3< where W is of degree 1. 
av) f = ( -4 } 
and the axioms are: 

(D NO ( i.e., in set- theoretic terms, 0 € N ) 

ai) Nx-4NxI (if the word represented by the variable 
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X is in N then th« word xl is also in IM. ) 

Using these axioms, the system of natural numbers is formally represented 

over ,4,0 as N = £ 0, 01, Oil, 0111, Ollll, 3. N is called the system of 

Constructive Natural Numbers 1201, [313. 

REMARK We note that in the above example we have used the same s^^iysol N for 
denoting the predicate and the set of natter al numbers. 

Now, we show with the help of the following two propositions, that signal 
spaces and constructive signal processing systems are formally representable 
over finite alphabets. Here, we refer to subsets of a free monoid as signal spaces 
and algorithms such as associative calclui and normal alorithms as constructive 
systems. 

PROPOSITION 5.1.1 

¥ 

Let Sjj be a subset of a free monoid .4, and let S be an associative calculus 
that recgnizes Then, is representable in an elementary formal system 
over J, . [ Subsection 1.4 3 
PROOF: 

Recall from section 1 that elements of the set Sjj are equivalents with 
reference to the defining system JD of ft, where JD is an unordered list of J-class 
equivalence relations. We now, construct an EPS Ej^ for representing the set Sj^. 


Alphabets ; (i) A 

(ii) IfsCaiSxyvw} 

(iii) IP = £ f r » 

(iv) f =£-♦»} 

Axioms : (i) Sj^x 

(ii) fx,ax)3-*ryx-+50vw 


( a given alphabet ) 

( a and j3 are improper variables and x, y, 
V and w are proper variables. ) 

( Sj^ is a predicate of degree 1 and f, r 
and ® are predicates of degree 2. ) 

( punctuation symbols ) 

( X is an element of Sj^ ) 

( if X is the factor of a word 
axj3 then y is the 
replacement of x ^#uch 
in turn implies that a 
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word v=sax<3 is a a)-equi- 
valent of Wsray/3 > 

(ill) fyAy)3-4rxy-4l0vw ( if y is the factor of a word 

»y/3 then x is the 
replacement of y which 
in turn implies that a 
a word v=«yj8 is a JD-eaui- 
valent of w=ax)3 ) 

(iv) ®vw ( V IS a ©-equivalent of w ) 

Let <Xj , yj^> , l:^iin be the n ordered 3-class relations of the defining system 

B of an associative c)^l cuius ft For any pair of equivalent words v and w in Sjj , 

©vw IS provable in by the inductive instantiation of axioms (ii), (iii) and (iv), 

using the 3-class relations of © Now, given any two arbitrary words v and w in 

, if ©vw IS provable in Ej^ , then v, w € Sjj Hence, is representable in an 

elementary formal system E^ over A. 

PROPOSITION 512 

Let be a subset of a free monoid A* and let Jf be a normal algorithm that 
recognizes Wj^ Then, is representable in an EFS, Ej^^ over A 
PROOF 


As we recall from subsection 2 2, a normal algorithm 3f over an alphabet A is 
interpreted as an 3-class presentation of the free monoid A defined by an 
ordered list of n 3-class partial order relations corresponding to the n 
substitution formulas of Jf We now, construct an EFS, Eji^ for representing the 
set Wj^ 

Alphabets (i) A < the given alphabet ) 


Axioms 


(ii) y' = {«/3xyvw} (a and j8 are improper variables and x, y, 

V and w are proper variables ) 


(ill) y = C a f r ( a and W ^ are predicates of degree i 

and r and f are predicates of 
degree 2 ) 

(iv) / = {-»,) ( punctuation symbols ) 


(i) W 


C 1 e , set theoretically x € ) 
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(ii) fx,ax0-4ryx-4av ( if x is a factor of a word v=axi8 

then y IS a replacement of x in v 
which implies that v is amenable 
to Jf ) 

<v) av ( V IS amenable to Jf ) 

Let <Xj^ , sii> I l^i^n be the n ordered J-class partial order relations of the 
scheme © of a normal algorithm Jf For a word v in , the axiom av is provable 
in by the inductive instantiation of the axioms (ii) and (iii) using the relations 
of © Now, given a word v in v^*, if av is provable in then v 6 Hence, 

IS formally representable in This completes the proof 

Since Sjjj and are formally representable in the elementary formal systems 
Ej^ and Ej^ respectively, the classes of associative calculi and normal algorithms 
are formally representable over an alphabet J, 

5 2 FORMULATION OF A STRING MANIPULATION LANGUAGE 
FOR CONSTRUCTIVE SIGNAL PROCESSING 

Since subsets of a free monoid and algorithms such as associative calculi and 
normal algorithms are formally representable in EFS' over alcrfiabets, the 
possibility exists of studying signal spaces and constructive systems in an EFS 
type language We find that Fitting's notion of EFS type string manipulation 
languages [143, is useful for this purpose Before attempting to formulate one such 
language for constructive signal processing, we review some of the basic details 
regarding the EFS language of Fitting 

5 21 FITTING'S BASIC STRING MANIPULATION LANGUAGE EFS(str<L)) 

EFS(str(L)) IS a representative example of an EFS language for a data 
structure of character strings over an alphabet, say L 
DEFINITION 5 2 11 C143 

EFS(str(L)) over an alphabet L is defined to be a collection of the following: 
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(i) an alphabet L of distinct symbols 

<ii) a data structure < L , CONl > where L is the free monoid of L 

and CONl is a 3-place relation < u,v,w > such that for any three 
U)V,w € L , w IS the word obtained by right concatenating v to u 
<iu) a set of identifiers which are words consisting of capital letters 
from the English alphabet 

(iv) an alphabet consisting of variables denoted by x, y, z etc , arid 

(v) an alphabet consisting of punctuation symbols • {-♦(),} 

The notions term, atomic statement and u/ff of EFSCstrtD) have to be 
understood as they have been defined already in subsection 5 1 

A work space W of an EPS , in general, consists of the following 
(i) a specification of a domain 

ill) a list of resented identifiers < The term Identifiers refers to 

predicate labels A reserved identifier will not occur in 

the position of the conclusion of a statement (wff) ) 

( 111 ) a specification of what relations the reserved identifiers 

represent Such relations are the gii/en relations of W. 

Every elementary formal system is associated with its basic ufork space For 

instance, the basic work space of EFS(str(L)) consists of the following 

ft 

(i) the domain L 

(ii) the only reserved identifier CON . 

(ill) the label CON represents the concatenation relation CXWl on L 
A procedure P in a work space W is a list of acceptable statements written 
one below the other like a PASCAL program The first statement is known as the 
header and the block of remaining statements as the body of the procedure The 
header designates an unreserved identifier together with degree n of the 
predicate for which the identifier is the label The identifier in the header 
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represents the name of the procedure and its output as well 
EXAMPLE 5 2 11 

EPS language EFS(str(L)) 

Data structure . < L , CONt, > 

3L 

Work space < W ) (i) Elements of L 

(li) CON ( the reserved identifier with 
degree 3 ) 

<iii) CON represents concatenation of an 

element v to the right of another u 
such that uv=w , u,v,w € L 

Name of the procedure FAC(2> 

FAC<2) 

FAC(x,x); 

FAax,A), 

CON(x, y, z) -4C0 N(v, z, y) -tF AC(y, x> 

jK X 

The language recognized by the procedure FAC is L x L 

The computation of a procedure P in a work space W gives rise to sequences 
of statements of the following kinds 

(i) a substitution instance of a procedure statement 

(ii) an instance of a given relation of W 

(lii) an assignment statement T where its previous line is 

X^-fX 2 -+ - -»T and X^, X 2 , . - 1 T are atomic statements. 

A sequence of statements resulting from a computation of a procedure P is 
known as a trees, which is analogous to what is called a deru-'&tion in mathematical 
logic A restricted trace is the sequence of statements governed by the first two 
conditions for a trace and by a third condition known as the restricted assignment 
rule This rule allows statements of the form X-»F where X is atomic and the 
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assignment F need not be 

The basic work space of an EPS can be expanded by adding to it more and more 
reserved identifiers as needed For exatmale, the basic work space W of EFS(str<L)) 
could be expanded as W' by adding FAC as a reserved identifier Now we shall 
construct a procedure GREQ in W' which would compute the graphical equivalence 
between two words, in the following manner 
Let the basic alphabet be L = { 0 I ) 

GREGl(2). 

GREQ(x,x), 

FAC(y,x)-»FAC(x,y)-»GREQ(x,y) 

A trace of GREQ would be of the form 
GREQ(2) 

GREQ(JOI.IOI); 

FACdOl, 10l)-tFAC(IQI, IOI)-fGREQ(IOI, 10 1) 

EFS(str(L)) has an enormous language (subset) recognizing power This can be 
inferred from the following argument 

Let P be the class of all possible procedures i^ich could be constructed in W 
of EFS(str(L)) Then, P is said to consist of basic or first lewel procedures The 
procedures which are constructible only in and not in W are called second le\/el 
procedures As already mentioned, W' is an expanded work space of W with an 
additional reserved identifier which has been used previously as an unreserved 
identifier in W Every such urreserved identifier, let us call it " i ", i^wan 
individually added to W as a reserved identifier, forms an expanded work space W'^ 
in which a class P'^ of second level trocedures can be constructed Likewise, the 
basic work space W along with two distinct reserved identifiers i and j , 
forms the work space W\j in which P'^, , a class of third lei/el procedures can be 
constructed. The generalization of the basic work space expansion in the above 
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manner exhibits the language recognizing power of EFS(str(L)) 

52 2 THE STRING MANIPULATION LANGUAGE EFS(splU)) FOR 
CONSTRUCTIVE SIGNAL PROCESSING 

With the material covered in 521 as the required background, we shall now 
formulate a string manipulation language EFS(spl(>A)) for constructive signal 
processing 
DEFINITION 5 2 2' 

EFS(spl(,A)) over an alphabet -A is defined to be the collection of the following 

(i) an alphabet v4, of n distinct symbols 

„ ¥ 

(ii) a data structure < A , CON j , SET , > where A is the free 

monoid of v4, , CON^ is a 3-place relation <u,v,w> such that w is 

at 

the concaL.naled string uv • <u,v ^ A ) , and SBT^ is a 
2-place relation <u,v> such that v is substitute of u where 
u,v € A^ 

(ill) a set of identifiers denoting predicate labels [ A break symbol 
" _ " could be used in writing identifier labels For example, 
FAC_OF IS a valid identifier whereas " FAC_ " or " _CF " 
are not 1 

(iv) an alphabet consisting of variables of two types (1) u,v,w,x,y,z 

which range over A^ and (2) which range over A [ The 

variables could be subscripted or superscripted as per 
requinement 1 

(v) an alphabet consisting of punctuation symbols {-♦(),} 

The basic work space W of EFB(spl(v4-)) consists of the following 

at 

(i) the domain A 
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(ii) CON and SBT are the only reserved identifiers 

(iii) CON represents the concatenation relation CON^ on A ; 

SBT represents the substitution relation SBT^ on A 
In general, the output of an EFS procedure is called a generated relation Let 
R be a reserved identifier denoting the predicate R of degree n. Then, a procedure 
of the type S(n) R<Xj^,X 2 i ,Xn) -4 S(Xj^,X 2 , ,Xn) we express as 

S(x^,X 2 , ,Xn)«R<X£,X 2 , ,Xn) or more briefly as S(n)»R(n) 

The following types of expressions are admissible 


(l) 

S(n) 


R{n) 

(11) 

S(n+1) » 

R(n) 

aii) 

T(n) 

<4 

R(n)AS(n) C A denotes the logical conr^ctive AND 1 

(iv) 

T(n) 


R(n)VS(n) [ V denotes the logical connective OR 3 


At times, one might come across a situation where a relation R denoted by 
reserved identifier R is of degree greater than that of its generated relation S 
by one In such a case, S(n)«R(n+l) is not an admissible expression On the other 
hand, the projection S of R is expressed as S(xj^,X2»-./Xn)t»{3y)R(XjL,X2/. .,Xn,y) 
which means that there is a y for which R(xj^,X 2 . .jXn,y)-4 S(Xj^,X 2 , . ,Xn) is valid 

With these details, we now show that given an alphabet A and a normal 
algorithm over it, one can always construct a functionally equivalent EFS 
procedure in the language EFS(spl(«A» 

Let us consider the following EFS(spl(^)) procedure RRW<2), whose work space 
W' is the basic work space W of EFS<spl(X» along with the reserved identifier FAC 
denoting the relation ( factor of ) FAC of rank 2. Let RRW<2) be a generated 
relation that represents the binary relation rewritten string of Now, we construct 
a procedure which will do the same job, that a substitution formula in a normal 


algorithm would do 



RRW(2) 
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SBT(A,x)-tRRW(A,x), 

SBT(x,A)-+RRW(x,A), 

t 

FAC(Q,x) -fSBT <x,y) -♦FAC(Q^,y)-*RRW<Q,Q^) 

A trace of RRW<2) for ^ = C 0 I } would be of the following form 
RRW(2) 

SBT(AJOI)-»RRW(A,IOI>, 

SBT(IOI,A)-tRRW(IDI,A), 

FACdlOIIO, 101) -»SBT(IOi,OOI) -»FAC(DOIIO,OOD -tRRWdlOID, DOID) 

So, given an alphabet A, one can realize any substitution formula over A with 
the help of the procedure RRW(2) in other words, for any normal algorithm Jf over 
A, there is a functionally equivalent EFSCsplU)) procedure 
EXAMPLE 52 2 3 

Let us construct a procedure for the cyclic permutation of a string of 
symbols from an alphabet A 

Language used EFS(spl(w^,)) 

Data structure < A^, CON^ , SBT^> 

Work space W" Basic work space W, together with the reserved 

identifiers (i) FAC and di) RRW 

Name of the procedure CPS (2) [ CPS represents the binary relation 

Cyclically Permuted String of 3 

CPS<2) 

CPS (A, A), 

CPS<f, a 

C0N(u,e,x)-»C0N(e,u,Xj^)-»SBT(x,x^)-4RRW<x,Xj^)-+ 

CPS(x,X£). 

The fact that for a normal algorithm over an alphabet A there is a 
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functionally eciui valent EFS(spl(^)) procedure, admits the possibility of obtaining 
EFS(spl(«^)) procedures for constructive signal processing systems We shall verify 
this in the following 

Firstly, we introduce here the notion of a reseri/ed &lphsbet as an EFS 
analogue to the alphabet of auxiliary symbols By a reserved alphabet, we mean an 
alphabet that is included in the work space whose symbols do not appear in the 
output of a procedure. 

Next, we show one methc'i of implementing a binary operation between two 
discrete data sequences pCn) and q(n) by means of an EFS(spl(vt)) procedure 

As outlined in subsection 42, the data sannples are coded as words from a 
suitable alphabet A so that the data sequences p<n) of M samples and cKn) of N 
samples could be expressed as the coded strings PTdp and Qtdq respectively, where 
Ptdp = P£dpP 2 dp Pjdp *^P^M ' and Qtdq = Qj^dqQ2dq .Qjdq .dqQ^q , l^j^N , 

dp and dq are two different delimiters from the delimiter alphabet 3) Now, these 
coded strings are expressed as a *-pair (Ptdp)*(QTdq) where the auxiliary symbol * 
IS a delimiter from the alphabet 3) Then, the *-pair is manipulated by means of a 
suitable normal algorithmic system SB in such a way that the resulting string Rtdp 
corresponds to the output r(n) due to the intended operation between the given 
data sequences p(n) and q(n). 

A ^-system of words from an alphabet v4, is an admissible term in an EFS 
procedure Let the symbol * denote a binary operation Then, *-terms such as (uf v) 
and ((uXv)X(wXx)) are admissible atomic terms in an EFS procedure A sequence of 
atomic terms is called a formation seauence If in a formation sequence, the last 
term happens to be a I-term, then the H-term is called a type-i term. Such type-i 
terms are allowed in the procedure statements of EFS(spl(.4,)) also This means *- 
pair inputs to normal algorithms also act as inputs to EFS(spl<v4.)> procedures 

As described in 1143, an input accepting procedure would consist of the header 
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statement of the form shown below. 

OUT_NAME <n) INPUT 1N_NAHE (k) 

(Procedure Body of OUT_NAME) 

DUT_N^^E represents the name of a procedure and the identifier corresponding to 
the output which is an n-place relation IN_NAME represents the input to the 
procedure and it is a k-place relation IN_NAME is neither a reserved identifier 
nor a generated relation If tt« IN.NAhC and (XJT_NAME are simultaneously n-place 
relations^ then the corresponding input accepting procedure is said to give rise to 
a mono^jne operator ^ which is nothing but a mapping from a set of n- lace 
relations to another set of n-place relations satisfying the condition 
X C Y =» ^(X) C ^(Y) , X,Y € D, the domain of the EPS 
Me recall from subsection 4 2, that a constructive signal processing system is 
a normal algorithm or a set of normal algorithms combined in a manner that is 
allowed by any of the combination theorems of Markov 

In the same way, procedures that are written in various work spaces of 
EFS(spl(v4)), can be combined on the basis of the following theorems - 
THEOREM 5 2 21 

For any three relations R(nj^), S(n 2 > and Ting), if Sing) is the generated relation 
of Rlnj^) being applied to a procedure P^ in W'^ and Ting) is the generated relation 
of Sing) being applied to a procedure Pj in W'j , then one can construct a 
procedure Pj^ in W'|^ which is the union of Wj and Wj such that Ting) is a generated 
relation of Rln^^) being applied to P|^ 

PROOF- 

Let us assume that n^ = ng = ng = n Then and can be treated as the 

monotone compact operators defined by the input accepting procedures Pj , Pj and 
P(^ Now, as Fitting shows in [141, if the input to an operator defined by a 
procedure is a generated relation, then so is the output. 

In the light of this proposition, we observe that if R is an input relation to 
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such that its output generalad relation S when applied to yields the generated 
relation T . Then, there exisits a monotone operator which is the composition of 

and such that = T = 

The generalization of ^ relations with n^ 9^025^03 yields PiPj^P^ 

which is known as the composition of procedures 
THEOREM 5 2 2 2 

For any three relations Rin^), 8(02) and TCng), if 8(02) is the generated relation 
of R(n being applied to a procedure in W'^ and T(n3) is the generated rexation 
of R(n^) being applied to a procedure Pj in W'j , then one could construct a 
procedure P|^ in W'|^ so that the generated relation of Rinj^) being applied to P|^ in 
W'jj IS the union of the relations 8(n2) and T(t\^ 

PROOF 

This theorem is applicable to only those inputs i^ch are awslicable to both 
Pj^ and Pj Let us assume that n^^ = 02 = 03 = n Then one can construct monotone 
operators corresponding to P^ , Pj and Pj^ which satisfy the union property such as 

(R) = ^j(R)U^j<R) = ^(^(R) 

This theorem can also be generalized for input accepting procedures which 
generate relations of uneoual arities 

We now give three additional theorems concerning the combination of 
procedures, they can be proved on the same lines as theorem 5 22 2 . Theorem 
5^2 4 IS a reformulation of a result of Fitting [141 
THEOREM 5 2 . 2.3 

For any three relations R(n^>, 8(n2) and T(n3), if S(n2) is the generated relation 
o.'' R(nj^) being applied to a procedure P^ in W'j_ and T(n3) is the generated relation 
of Rin^) being applied to a proceduff^ Pj in W'j- , then one could construct a 
procedure P^, in W'j^ so that the generated relation of R(n^) being applied to P|^ in 
W'j^ is the intersection of the relations 8(n2) and T(n3) 



THEOREM 5 2 2 4 
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For any three procedures and P,^ in W'^ , W'j and W',^ respectively, one 

can construct another procedure Pj in W'j so that, (i) if P^, does not accept R then 
neither P^ too, and (ii) if P,^ accepts R then Pj(R) is equivalent to Pj(R) when P^.{R) 
satifies a condition C and P^(R) is equivalent to Pj(R) when Pj^(R) does not satisfy 
the condition C 
THEOREM 5-22 5 

For an input accepting procedu » P^ in W\ one can construct another P^ in W'j 
such that S is the generated relation of R being applied to P^ and U) S is the 
least fixed point for P^ so that Pj(S> = S and S is the output or (ii) S is again fed 
to Pj and the corresponding generated relation is tested for the least fixed point 
Pj, IS repeatedly applied till its output becomes the least fixed point of Pj. 

REMARKS 

(i) The notion of a type-1 term allows us to feed a *-system of strings 
from the basic alphabet as the input to an input accepting EFS(spl(-4)) procedure 

(ii) The notion of a reserved alphabet allows auxiliary synt>ols in the 
statements of an EFS(spl(vt)> procedure. 

(ill) Complex EFS(spl(v4)) procedures can be constructed by making use of the 
above combination theorems 

Finally we remark here, that the string manipulation language EFS(spl(v4)) is a 
useful computational aid in realizing constructive signal processing operations. 

5 3 LANGUAGES GENERATED BY M-GRAMMAR BASED ON 
ON SEMI-THUE PRODUCTIONS OF POST WORDS 

So far we explored the possibilities of studying constructive signal 
processing systems in terms of formal languages Using the concept of Elementary 
Formal System of Smullyan, we proposed a string manipulation language EFSCspK^)) 
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as an extension to that of F itting's EFStetKD). Finally we gave a method of 
implementing signal processing operations by means of certain EFSCspKvt)) 
procedures. 

In this subsection, we consider the problem of finitely specifying the 
potentially infinite languages of a free monoid recognized by constructive signal 
processing systems, by means of a set of rules called M-grairtmar. 

5 31 THE PROBLEM OF GENERATING Mf.RKOV CLASS REWRITING SYSTEMS 
BY A TYPE-0 PHRASE STRUCTURE GRAMMAR 
We start with the following definition 
DEFINITION 5.3 1 1 

A Markoi/ class reuniting system (process) is defined as an ordered pair 
<E, S> where the alphabet E is the union of the terminal (basic) alphabet J, and 
the alphabet S consisting of non terminals (auxiliary variables) , and S is a totally 
ordered list of semi-Thue productions, which are pattern substitution formulas of 

the type any string of E ) any string of E 

With this definition in mind, we shall view a normal algorithm as a Markov 
class rewriting process, or more generally, as a Markov class rewriting system 

Now, the following two theorems of the established literattre highlight the 
fact that Markov class rewriting systems can be defined only by a type-0 grammar 
of Chomsky heirarchy 
THEOREM 5 3 11 (Detlovs) C213 

The class of normally computable partial word functions is equivalent to the 
class of partial recursive word functions 
THEOREM 5 3 1.2 (Davis and Chomsky) [541 

A language LCv4* is generated by a formal grammar <E,P,,/i> if and only if it 


IS recursively enumerable 
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The languages recognized by the class of normal algorithms over an alphabet 
A are recursively enumerable and so can be finitely specified only by a type-O 
grammar 

DEFINITION 5 312 C54] 

A (type-0) phrase structure grammar , also called a semi-Thue process, is 
an ordered quadruple <E,P,S,v4> where, 

(i) E IS a total alphabet, 

(ii) A IS the terminal alphabet, 

(ill) E\vt IS the alphabet of non terminals, 

(iv) P IS a set of semi-Thue rewriting rules of the type String 1 ) String 2 

where String 1 can be any string of terminals and non terminals that 
contains at least one non terminal and String 2 is any string of 
terminals and non terminals whatsoever, and , 

(v) S IS known as a Start smbol which is in E\4. 

Gj defines a semi-Thue rewriting system <E,P>. 

From the above definition it is clear that a type-0 grammar does not allow 

semi-Thue productions of the form A ) String 2 where String 2 is from E. 

But the notion of a normal algorithm does allow substitution formulas of the form 
^ String 2 Therefore, it is not possible to define Markov class rewriting 
systems directly by a type-0 grammar of Chomsky heirarchy 

We overcome this difficulty by introducing a grammar, which we call M-grammar, 
for describing Markov class rewriting systems To do this, we restructure 
substitution formulas as semi-Thue productions corresponding to certain 
representations of a Turing machine, called cfuaaruples that operate on special 
words known as Post words Post words are words of the type hkqwih where h is an 
auxiliary letter, k and t are words from an alphabet S and q^ is a letter from a 
state alphabet of a Turing machine 
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5 3 2 FORMULATICN OF M-GRAMMAR 

Recently Babikov C36] proposed a method for realizing normal algorithms in 
terms of Turing machines by representing normal algorithms in an index alphabet 
of a semi-Thue system Using this method, every substitution of a normal algorithm 
IS replaced by a certain system of substitutions of a semi-Thue system which 
operates on Post words and thus the appropriate Turing machine is determined 
Babikov refers to Post words as words of the type hkow^h where h is an auxiliary 
letter, k and t are words from the alphabet C JCA3 over which the normal algorithm 
IS constructed, q is a letter from Q and w is a word from SUC1)2,3, ,m}; m=f(n) 

IS a finite integer function of n. Our M-grammar is primarily based on this idea 
kle proceed as follows 

Recall that a Turing machine is described by a set of quadruples of the 
following types . 

(i) q^s^Sj^Qj < being in the state the machine scans the symbol Sj , prints Sj^ 

in the place of Sj and goes into state q^ ) 

(ii) q^SjRqj ( being in the state the machine scans the symbol Sj, moves to 

the right adjacent square and goes into state qj ) 

(ill) Oj^SjLqj ( being in the state q^ the machine scans Sj , moves to the left 
adjacent square and goes into state q^ ) 

For deterministic Turing machines, no two quadruples can have the same pair 

Now, let us consider a deterministic Turing machine ^ with the alphabet 
S = {s^,S2, ,S|^ ) and the state alphabet Q = £ qj^,a2> • »<5n 3 The semi-Thue 
productions corresponding to the quadruples of this Turing machine are as 
follows 

(i) qj^SjS|^q|i corresponds to the semi Thue production Cj^Sj -f 

(ii) Oj^SjRq^ corresponds to 1. OjSjSj^ > SjOj^S;^ , ( k=0,l,2, jK ) 



(iii) Q^SjLq^ corresponds to • 1 s,^q^Sj ^ q^s^s, , ( kn:0,l,2, .,K > 

2 hq^Sj >hq^ASj 

Let us assume the configuration of ,/fc at a particular stage of corwutation to be 

^2 S SgSg 

*^4 

This corresponds to the Post word hs2q4Sj^SQS3h Let us assume that Jh contains 
the quadruple 045 ^Sgq^ so that the corresponding semi Thue production is of the 

form 045 £ > <3553 According to this production rule, the Post word 

hs2q4Sj[SQS3h is rewritten as hS2q5S3SQS3h In a similar manner, the rewriting of 
Post words by virtue of the production rules corresponding to the remaining two 
types of quadruples of ,/lb can be verified. A system of semi Thue productions 
corresponding to certain quadruples of a Turing machine ,/lb and which operate on 
Post words, is called a semi-Thue system denoted by E(^) 

All the three types of semi Thue production rules allow only letter to letter 
substitution But a word to word substitution formula of a normal algorithm, as we 

£ SL 

know, IS a restriction-free mapping of the type E » E So the question that 

arises here is whether it is possible to restructure the substitution formulas of a 
normal algorithm as semi-Thue production rules which operate on Post words. 

In this context, we propose the following technique by which a word to word 
substitution IS realized by a block of letter to letter substitutions Firstly we 
shall agree to the following assumption • 

ASSUMPTION 

Any configuration of a Post word can be represented in infinite number of 
ways by including any number of blanks corresponding to null strings, in between 
any two symbols in the configuration 

On the basis of this assumption, we can make the lengths of the pair of words 
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that form a substitution formula, equal, by padding the shorter word with the 
required number of A's For example, we can restructure the substitutiton 

formulas (i) /3F > af/3 and (ii) OlJf > 0 * as a) /3FA ^ *ej3 and (ii) 

0 *F ^ DfA respectively 

For convenience, we shall call this technique End Justification. End 
justification is done in two ways, that is, the pair of words of a substitution 
formula is either left justified by suffixing the shorter word with A's or right 
justified by prefixing the shorter word with A's After the end justification of the 
pair of words, the word to word substitution due to the corresponding substitution 

formula which is a map of the type E* y E* could be replaced by a block of 

letter to letter substitutions of the type EUCA) ► EU{A3 Now, the block of 

semi-Thue production rules corresponding to the block of letter to letter 
substitutions IS obtained in the manner described above 

We illustrate this technique of restructuring a substitution formula in the 
following example 
EXAMPLE 5 3 2 1 

Let us consider a substitution formula Sj^S 2 Sj^S 3 ^ S2®2®i end 

justified version of this formula would be of the form Sj|^S 2 S^S 3 ^ S 2 S 2 Sj^A and 

the corresponding block of semi-Thue productions would contain the following • 


Table 5 3 2.1 Semi-Thue productions corresponding to the end justified 
substitution formula Sj^ 525^^53 ^ ^ 2 ^ 2 ®!^ 


1 

SI No 

Post words 

Semi-Thue productions 

Remarks 

1 

^iO®lS 2 «il 

<51031 ^ 

letter substitution 

2 

«iiS2R'=«ii 

^ 3201^52 

right move 




1 


contd.. 



91 


3 

qiiS2S2Qi2 

^>11^2 ^ <^12^2 

letter substitution 

4 

^i2^2^^i2 


right move 

5 

‘5i2®i®i<5i3 

qi2Si ) q^sSj^ 

letter substitution 

6 

‘='i3®i*^^l3 


right move 

7 

'^i3®3^°'i4 

i 

°'i3®3 ^ '’14^ 

letter substitution 


Now, the semi-Thue system E(A>) consisting of the above production rules 
operates on the corresponding Post words, thus simulating the effect of the 
formula s^S 2 S^S 0 ——4 

Let us consider a normal algorithm Jf over an alphabet J, whose scheme 
consists of n substitution formulas Then, each of the n formulas can be replaced 
by the appropriate blocks of semi-TKie rewriting rules The totally ordered list of 
all such blocks gives rise to what we call as End- justified Post Turing (EPT) 
rewriting system whose definition is given below 
DEFINITION 5 3 21 

An EPT rewriting system is an RE-analogue (Recursively Enumerable) of a 
Markov class rewriting system and is defined as the 4- tuple <E,Q,h,P> where E is 
the total alphabet, Q is the state alphabet consisting of { O^i^m , O^j^n such 
that q,, represents states corresponding to the 1 ^^ block of end justified words of 
length n 3 , h is an auxiliary symbol known as end marker and which is used in the 
construction of Post words and P is the subset of the Cartesian product 
(hE*q^jE*h) X (hE*q|^jE*h) , known as the finite list of semi-Thue productions which 
operate on Post words 

We shall demonstrate the working principle of an EPT rewriting system by 


means of the following example 
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EXAMPLE 5 3 2.2 

Lot us consider the scheme of the oyolio shifting normal algorithm, t Ref 
Subsection 4 11 ] The semi-Thue system corresponding to is the totally 

ordered list of ten blocks of semi-Thue rewriting rules as given in table 5 3 2 2 


Table 5 3 2 2 Semi-Thue system corresponding to 


SI No 

Semi-Thue productions 

Remarks 

0 

dif^L } QqqE 

Input 

1 


Block 0 
corresponding 
to the formula 
faiiF > itlFfa 

2 

cioof ^ QOl^ 

3 

> iiQQ2^ 

4 

qQ2E\iK 

5 

Qq2<x^ ^ ^03^ 

6 

qc^rr — ► FocmE 

7 

^ Q^QlOXfl 

8 

Qq^II ► QqS? 

9 


10 


11 


12 

^07^ ^ ^^08^ 




contd 



15 


qjl^QO i 


16 

C( f IJLQjj2^ 

17 


18 

<312^ f 

19 

cii3rE f rcij^i|,E 

20 

ai4E\r — \ q2qT^\t 

21 

ai4r \ Qisa 

22 

qj^ga— > aQj^gA 

23 

q^gA > ciooA 

24 

q2oZ:\/3 ► dsoE^e 

— i 

25 

Q20^ ^ ‘^21** 

26 

02 jCcXl — '4 ^Q22^ 

27 


28 

^22^ ^ ^23^ 

29 

023^ A ► ^^^24^ 

30 

q24A ► ci250 


Block 1 
corresponding 
to the formula 
anr ^ (iTa 


Block 2 
corresponding 
to the formula 






















32 


ci 26 ^ ^ ^ 00 ^ 


33 


34 


35 


36 


37 


38 


CIggENO! ^ C|^qE\0! 


°l30“ ^ 


q3£0E > 0q32E 


q32E\a > q4QE\a 


q32a \ 


a33A ^ QqoA 


Block 3 
corresponding 
to the formula 
aa — > 


39 


40 


41 


42 


43 


44 


q^gEX^ ^ ^50^^^ 


q4g^ > *^4i^ 


q4j^rE ► rq42l^ 


q 42 E\j 8 ^a 5 oE \0 


q42^ ^ *^43^ 


q43A ^ OoO^ 


Block 4 
corresponding 
to the formula 

m — tr 


45 


46 


47 


48 


qggEXr » qggEXr 


^50 ^ — ^ *^51^ 


qgiFE ^rqgzE 


qg2E\a > cieo^'^* 


Block 5 
corresponding 
to the formula 

r« — » r 





























^ 53 ^ ^ 


^ ci<7QE\r 


^ <^61^ 



C|0qE\O^ 








2^ ^ QI73A 


q73A ^ OoG^ 




<=< 80 *^^ — * '’FInA 


QggA ^ Qg£<* 


Block 6 
corresponding 
to the formula 

rn > nr 


Block 7 
correspOTiding 
to the formula 
J8a > J3 


Block 8 correspon- 
-ding to the formula 

r — ^• 


Block 9 
corresponding 
the formula 
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67 


^ OC 

68 

Q 92 A > ^OqA 



Now, we define M-grammar 
DEFINITION 5 3 2 2 

The M-grammar is defined as a 7-tuple = < E, Q, INI, FIN, h, 1^, P > where 
E = SU(A3 IS the total alphabet consisting of the terminal and the non terminal 
alphabets ind the null string A > Q is the state alphatet, the number of eleme is 
of which depends on the scheme of a normal algorithm , INI ? Q is the initial state 
and FIN g Q is the final state such that Q' = QUCINI}UCFIN) , h is the end marker 
of a Post word from EUQ'UCh} , is the start axiom from EUQ'UCh) and P is the 
totally ordered list of semi-Thue productions operating on Post words 

M-grammar defines EPT rewriting systems The direct derivation relation of an 
EPT system is denoted by and defined as follows 

For some Post words u and v from EUQ'Ufh}, u ^ v means that there are 

Gm 

certain X 2 , *3 ^ and € Q' such that < u, v > € P , that is, 

< (hxj,q^jX 2 h), (hXj^qj^^x^h) > € P and ^ quaci'uple of a Turing machine 

The language generated by Gjv^ is defined as l-(Gjv^) where, 

L(G„) = { w 6 hvt*QU*h * 6 hE*QT*h w 3 
G|,^ generates potentially infinite languages of an alphabet and such a family 
of languages is denoted by L<M). Now the following theorem ascertains the 
recursive enumerability of the languages generated by Gf^ 

THEOREM 5 3.2 1 

L(M) = L(RE) ( The acronym RE stands for Recursively Enumerable ) 

The proof of this theorem is the direct consequence of the theorem 5 312 

Finally we remark here, that a language recognized by a constructive signal 
processing system is a subset of L(M) 



SECTION 6 


SPECIAL AUTOMATA FOR NORMAL ALGORITHMS AND THEIR TRANSCRIPTIONS 

It was shown in section 5, that symbolic signal processing operations could be 
carried out by means of Markov class EPT rewriting systems that are described by 
M-grammar 

It was also mentioned in the beginning of section u that a language is a 
subset of a free monoid and is recognized by a finite state machine (automaton) A 
language L is recognized by an automaton in such a manner that if we start with 
its initial state and feed a string from the free monoid, the final state will belong 
to a designated set if and only if the string belongs to L. 

The notions of automata and codes are closely associated with each other, in 
the sense that, a subset of a free monoid is not only known as a language but also 
as a code and the finite state machine that recognizes it, is called an automaton. 
Any signal representation is a code by itself and any finite state machine that 
simulates a signal processing system is an automaton 

In this section, we shall interpret signals as variable length codes over 
alphabets and normal algorithms as special automata, and briefly demonstrate a 
syntactic method of implementing signal processing operations by means of a 
system of such automata of accropriate normal algorithms 

There are occasions when it becomes necessary to encode the schemes of 
certain normal algorithms such that their coded forms become amenable to some 
other normal algorithms Hence, we shall treat a constructive signal processing 
system either as a code or as an automaton depending on the reauirement. Before 
going into the details, we shall review some of the preliminaries required for our 
study from [61 , £211, £221 and £261 As tutorial aids, examples relevant to our study 
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are added to clarify the main ideas 

6 i CODES AND AUTOMATA 

w 

Let vt be an alphabet and ^ be its free monoid Then, a word w € is 

called pnmitii^e if it is not a power of any other word For example, the word 

P = 1010 1 from the alphabet »,4.o = (01) is a primitive word whereas the word 

Q = DIO IS not, because Q is the second power of the word 10 

Two words x and y are said to be conjugaiB if there exist two other words u 
and V such that x = uv and y vu Conjugacy relation is an eouivalence relation 
Equivalence classes for this relation are called conjugacy classes It is at times 
convenient to say of conjugate words x and y that x is a conjugate of y or 
equivalently y is a conjugate of x [ Note The null string A is a conjugate of 
Itself 1 

Given a pair of conjugate words, one can obtain a word of the pair from the 
other with the help of the cyclic shifting normal algorithm K [Subsection 4.1 13. 
For example, x = 010 10 1 and y = DIO 10 are two conjugate words from the alphabet 
= f 0 I 3 such that x = and y = Likewise, in the case an arbitrary 

pair of conjugate words, x and y, we can get x from y by n applications of Jf , x 
= (Jf*^®)^(y) , for some n, 0 i n i ty| 

[ Note- |y| denotes the length of the word y and (Jf°®Ay) denotes the n number of 
successive applications of the normal algorithm to the word y 3 

PROPOSITION 6 11 

Let C be a conjugacy class of words of length t with an exponent n Let x 
be a word in C of the form x = r*^ where the primitis/e word r is a root Then, 
for any other word y in C there is a root q such that y * q Further, the 


cardinality of C is t/n 
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PROOF 

Let X be a word in C such that x » and let |r| be p Then 1x1 = on = t. 
Now, the normal algorithm could be applied successively to the word x up to a 
maximum of p-1 times without affecting the condition that all words of C have the 
same exponent n In that case the conjugacy class C would consist of the following 
p words X, Jf°®(x), (Jf‘^®)^(x), (Jf^)^(x), , (Jf°®)^‘^(x) where p = i/n. 

EXAf^LE 6 i 1 

Let us considfc'- the alphabet v4, = Cabc}, a conjugacy class C = € x I x is a 

word of length 12 and exponent 4 3 and a word x = abcabcabcabc in C where 

r = abc and n = 4 Now, jr*^®(x) = cabcabcabcab where r = cab and n = 4 and 
<Jf'^®)^<x) = bcabcabcabca where r = bca and n = 4 So, the cardinality of C is 3 
DEFINITION 6 11 

A subset of X of vt* is called a code ot^er the alphabet A if for all n, m S: 1 
and x^xgXg xn , x\x' 2 x '3 x'm € X , the condition x^XgXg Xn » x'^x'gx'g x'm implies 
n = m and x^ = x'^ for i = 1,2,3, ,n 

Any subset of a code is also a code If X C v4* is a code, then X" is also a 

code for all n > 0 In general, coding is defined as an injective morphism 0 , 

0 ^ for alphabets A and », such that the following conditions hold 

% 

(i) For every symbol € € S there is one and only one 0(f) in A 

( 11 ) There is a proper subset X of A^ such that 0 induces a bijection 

of ® onto X 

The family of all possible codings from » onto X is denoted by COD(»,X) 

Let 0 $* » A^ be an injective morphism Then, 0(S) = X, where X is a proper 

suDset of the free monoid A^ is known as the coding morphism for X 
DEFINITION 6 1.2 . 

The subset X C vt* is a prefix (suffix) code if no element of X is a proper 
left (right) factor of another element in X , that is, X^'*‘nX = ^ for prefix code 



100 


( .A'^xnx = 4 > for suffix code ) The code X C is kncwn as biprefix if X is both 
prefix and suffix 

¥ 

Every submonoid M of a free monoid vi has a unique minimal set of 

2 

generators X = where A is the null string and X is a code. 

DEFINITION 613 

Let A be an alphabet Then, an automaton oi^er A is defined as a triple 
A = <Q,I/T> where Q is a set of slates, I and T are subsets of Q and are 
rei-oectively known as the initial and final states 

Edge is an element from the 3 - tuple Qx>X.XQ and the set of all edges of an 
automaton is denoted by ^ C QxAXQ A path of length n in an automaton is a 
sequence c = C f f2» .^fn ? of consecutive edges, where f^ = l^i^n The 

label of a path c of length n is the word w = 3^^3233 .ap where c = i f j^,f2i • »fn ^ 
and f = (Q^,ajj^,q2^ » f2 ~ Id 2 '® 2 '^ 3 ^ ’ ^3 " 103133,04) »• » fn = ^dn,3rvCip.^j^) In short, 
a path c of length n with the label w is denoted by c qj^ — * 5*— 4 

A path c q^ ^ Ot is called successful if and only if 0^6 I and q^C T The 

set of all sucessful paths of an automaton A is denoted by LIA) A stats q6Q is 
accessible or co-accessib2e if there exists accordingly a path o which is either 

c i ^ q and 1 € 1 or c a > t and t € T An automaton whose every sUte is 

both accessible and co-accessible, is known as a trim automaton A*=<P, lOP, TnP> 
where P is a set of states which are accessible and co-accessible Then, it can be 

verified that L(A) = L(A*) 

An automaton A = <Q, 1 ,T> is deterministic if the cardinality of 1 is i and if 
for any pEQ the edges (p,a,q) and (p,a,r) belong to the set 3 " implies q = r. For 
every pEQ and aEA , the transition function for an automaton A is defined as : 

p.a = q if (p,a,q) € iF 
= ^ otherwise 

This IS a oarlial funolicn of the taoa 0X,l — , Q autoaaloh is cowiaU if 
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for every p€Q and every there exists at least one q€Q so that <p,a.a> € 

THEOREM 611 

Let us consider an alphabet xA and a subset X of the free monoid Then X 
IS recognized by a finite automaton 
PROOF • 

If 

Let ^ xA > M be a morphism onto a finite monoid M and let us assume that 
# recognizes X Then, a finite automaton can be defined as A = <M,A,^CX)> with the 
transition function m a = m^(a) Let w be a word in X Ther A w € «^(X) if and only if 
<^(w) € <^(X) Then L(A) = X Hence, X is recognized by A 
DEFINITION 6.1 4 

An asidnchronous automaton is a generalized notion of an automaton. It has 
edges labelled either by a letter or by the null string sudi that tF C QxCAUAlXQ 
THEOREM 6 12 

If XCA IS recognizable by an automaton A, then X is also recognizable by 
A If X,Y C A are recognizable by A, then XY is also recognizable by A 
PROOF . 

Now X C A* Since X*= (X-A)*/ A€X is a valid assumption Let A = <Q,I,T> be 
a finite automaton recognizing X and let tf be the set of its edges Since ASX , 
edges of the types Oj^ — — — ^ or q^ — — — ► q^ , q^ , q^ € Q are not in IF This 

means IHT = Now let us construct another asynchronous automaton B = <Q,I,T> 
whose set of edges is JF' where JF’ = ^ U ( T X X I ) In the light of the 
definition of a successful path, we observe that the number of successful paths in 
B amounts to the free semigroup X"*" This means L(B> = X"*". Any successful path in 
B may contain an edge of the form c i|^ — tj, , tj^E T, ij^E 1 and an edge of 
the form c- t,^ — i,^ In other words, any word w in X"*" can be recognized as a 
successful path in B such as 

o 1 ^ - t^ — i 2 — t 2 — + ^3 — ^n tn and 
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= 1 and tn = J . i € I , 0 € T. 

Since X'^ IS recognizable, X is also recognizable if we assume that 
that is, A € ^ 

Now let us consider two finite automatons = <P,I,S> and A2 = <Q,I,T> with 
sets of edges tT ^ and ^’2 respectively i>Je shall construct an asynchronous 
automaton A3 with the set of edges JFg where 5’3 = Sf^U?r2*^< SxCA 3 XJ ) Now, A3 
recognizes XY 

definition 615 

To each automaton A = <Q,I,T> with the set of edges tF over an alphabet J. , 
QxQ 

a function ^ A ^ N is associated which is defined as : 

( p, ^(a), q ) s 1 if (o,a,q) 6 fT 
= 0 otherwise 

N is the semiring of natural numbers N®^*^ is called the monoid of N relations 
over Q , that is, to each pair (q^ , q,) € QxQ is related a nutiiier from N by virtue 

of the function 

# IS the morphism of the type A* > if the following conditions hold 

QxQ 

(I) <fr(A) = Iq '■ < Identity relation (q^^ , q^) € N ) 

(II) For any u, v 6 A*, . ^<uv) > 

Qk^ Q 

Then the morphism ^ is known as the representation of the automaton A over N. 
DEFINITION 616 

The formal power series, otherwise known as the behauiour of an automaton 
A = <Q,I,T> over an alphabet A is defined by 

(lAI , w) = 

t*i 

and designated by lAI The support of lAI could be seen to be the set recognized 
by A , i£ , the set L(A) 
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definition 617 

To every automaton A = <Q,1,T> over A , there corresponds another automaton 

called A , whose construction is as explained below 

Let us consider a new state which is not in Q and construct an automaton 

B = <QUq^, q*, q|c> with the set of edges 5 = tF^U ^ 2 ^ ^3*^ ^4 where 

= set of edges of A 

^2 = ^ <d*» a, q) . 3i € I ( <i,a,q) € iTj; ) 3 

‘Tg = C fr, a, q^) 3t € T ( (q,a,t) € f ) 3 

= £ (q*, a, q*) : 3i € I , 3t 6 T ( (i,a,t> € ) 3 

The restriction of B to the set of its states which are both accessible and co- 

* 

accessible yields the trim part of B , which is the desired automaton A . 

EXAMPLE 612 

Let us consider the alphabet A© * C 0 I 3 and the subset X * £ 0I0,0II0»0III0 3. 

* 

The automaton A which recognizes X and its corresponding automaton A are 
shown in Fig 6 1 1 and Fig 6 12 respectively. 



FICJURE 6.1 2- The trim automaton that recognizes X = £00,010,011103 
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example 6 13 

Lei us consider the alphabet = ( 0 I 3 and the subset X = 011*0 The 
automaton A which recognizes X and its corresponding automaton A are shown in 
Fig 6 13 and Fig 6 1 4 respectively 



f 


FIGURE 6 13 The automaton that recognizes the subset X = 011 0 



FIGURE 614 The trim automaton that recognizes the subset X = 011 0 


6 2 AN ALPHABETIC ENCODING OF NORMAL ALGORITHMS 
As mentioned earlier, it becomes necessary at times to encode the schemes of 
certain normal algorithms such that their coded forms become amenable to some 
other normal algorithms Markov devised a method known as transcribing a normal 
algorithm, by which the scheme of a normal algorithm Jf could be coded as a string 
from a two-lettered alphabet C233 
6 2 1 TRANSCRIPTIONS OF NORMAL ALGORITHMS 

In general, the scheme of a normal algorithm Jf operating in a certain way on 
words from a basic alphabet, say, A is constructed over a larger alphabet $ 
where » = A U S and 8 is the alphabet of auxiliary symbols Let C be another 
alphabet where C = ® U ( x y z 3 and the symbols x. y and z are not contained 


105 

either in ■A, or in 8 Now the normal algorithm is represented in the alphabet C 
in the following manner 

The substitution formulas of iC are written down in the order of succession 
of its scheme, placing the symbol z at the end of each substitution formula and 

replacing all arrows ( ^ ) and dots (• ) by the symbols x and y respectively 

For example, the following scheme 

jf an ti& ( M e ^ , ct € 8 > 

^ « 

could be represented in the alphabet C as a string of the form •• 

anxyllazxaz 

Now let us introduce a convenient ordering of symbols in the alphabet C Let us 

also denote by r^ , (liii;n) any of the n symbols of C and translate E Ref Theorem 

2 3 2.i 3 every symbol of C by using the coding rule 11 r^ ^ 0 1^0 in the 

alphabet v<o = C 0 ! 3 0 is an injective morphism of the type C y A, such that 

o 

BKC) = X IS the coding morphism for X = C 01^0 , l^i^n 3 It is not hard to see that 
the subset X consisting of (0,l)-links CDefinition 2 3.63 is a biprefix code [Definition 
6 i 23 over the alphabet wio fill t-he symbols of the string from C which 

represents a normal algorithm Jf are replaced by their translations by applying 
the coding rule H , then the resulting string in is called the transcription of 
Jf and IS denoted by CJf) For example, let us consider the following scheme 

Jf . an n« ( n € A , a £ S ) 

> a 

This IS represented in the alphabet C as a string of the form 

anxyn«zxaz 

Let us now define n as follows 

n X >010 


z 


0110 
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a — ^omo 
a — ► OIIIIO 
y — > OIIIIIO 

Now, £jf} = OIIIIOOillOOIOOIIIIDDIIIOOIIIlOQIIDOIOOIIllOOllO 

In general, transcription of any normal algorithm over an arbitrary alphabet 
is a word from the set 98 = 0 1 I^O The set 98 is a subset of the free monoid 

o 

and so iS a code 

In what follows, w < study some of the important properties of this code 

62 2 STRUCTURAL PROPERTIES OF THE BIPREFIX CODE 98 = 011*0 

PROPOSITION 6 2 21 

98 is a biprefix code 

* + + 

PROOF £6 C 98v4, 098 = ^ J, 98098 = ^ So, 98 iS a biprefix code 

0 0 0 

PROPOSITION 6 2 2 2 

The submonoid 98 of A generated by 98 = 011*0 is free 

o 

PROOF SK C A . Let D: C ^ A be a coding morphism for 9S Then H is 

o o 

injective and a bijection from C into 98 n is a bijection from C onto n(C ) Hence, 
£6 is free and its minimal set of generators 98 is given by (£6 -A)-<96 -A1 
DEFINITION 6 2 21 [61 

Let M be a monoid and N be a submonoid of M Then, N is called right unitary 
in M if Vu,v €M(u,uv€N=»v€N), that is , = N For convenience, we 

shall write N"^ instead of (N"*")”^ 

N is left unitary in M if Vu,v € M ( u,vu 6 N =» v € N ), that is, N<N'*’) ^ = N 
The submonoid N is called biunitary if it is both left and right unitary. N is said 
to be stable in M if Vu,v,w € M ( u,v,uw,wv € N =» w € N ). 

PROPOSITION 6 2 2 3 

The free submonoid 98* of A generated by the set 98 is biunitary and stable 

o 

X 

in A 

0 
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PROOF Let us assume u=Ol'o, v=0l^0 and w=Ol''o such that u,v,w € J.* Now 
„ 0 

u,v,uw,wvess because OI^O, OI^O, OI^OOI^O, Ol'^OOlb € 9S* and so w 6 8S* Hence, SS* 

IS stable in J,o Using similar arguments, we can see that SS* is biunitary in vt* 

0 

The relationships between the unitanness and stability properties of 98 is 
shown in Figure 6 2.2 1 


(stability) 



(biunitariness) 


FIGURE 6 2.2 i- Relationships betwe^ unitanness and stability properties of 
the code 98 * Oiro 


If XCv4, IS a code then every subset of X is itself is a code This brings out 
the notion of maximal codes A code is maximal over an alphabet if X is not 
contained in any other code over J.. That is, for XCX' , if X' is a code then X=X' 
Maximality is not algorithmically verifiable, but it is decidable for recognizable 
codes Propositions like " Any code X over A is contained in some maximal code " 
are provable only by means of nonconstructive methods, which admit the existence 
of a least upper bound in the set of codes over However, as outlined in E61, the 
extremal properties of codes could be studied in terms of what is known as a 
completeness by replacing an extremal property by a combinatorial one 
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DEFINITION 6.2.2 2 C63 

Let P be a subset of the free semigroup A* where is an alphabet An 
element m in is completable in P, if there exist u and v in such that umv€P 
P IS said to be dense in if every element of is completable in P P is said 
to be complete if P is dense Every dense set is also complete. A subset of a 
monoid which is not dense is called thin set. All maximal codes are complete All 
thin complete codes are maximal 
PROPOSITION 6 2 2 4 

The biprefix code JB is thin and not maximal 
PROOF 

9G would be thin if there is at least one element in A which is incompletable 

0 

in 9S One such element which is incompletable in 9S is iOl So, £S is thin Moreover, 
the element IOl is incompletable in 9S also This means 9S is not dense. Hence SG 
IS incomplete and not maximal 
PROPOSITION 6 2 2 5 

Let Xj and Xj be two thin biprefix codes which are finite subsets of S8. Then 
X^Xj is thin 
PROOF 

* 

Let us consider two words u and v in -4 which are incompletable in X, and X, 

D i. 4 

respectively Then the word uv is incompletable in X^Xj . So X^Xj is thin 
DEFINITION 6 2 2 3 [63 

Given a subset N of a monoid M, the set of those elements of M which are 
factors of elements in N is defined as FIN) where FINISH ^NM ^=Cm€M | 3 u,v€M 
umv € N > and F(N) * M-F(N^ N is a proper subset of FIN) A code X C is 
called I'ery thin if there exists a word in X^ which is not a factor of any word in 
X In other words, X is very thin if and only if X*nF(X) # For example, let us 
consider the code X = C 0"l0^ I n i 0 } over the alphabet v4o = ( 0 I 3 This code is 
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2 

very thin because the element I which is not a factor of any element of X, is 
present in X*nF(X). 

PROPOSITION 6.22.6 

Let X be a subset of the code 9S « 011 0 Then X is very thin 
PROOF 

Since no other element in 9S excepting the set 03 , is a factor of any of the 
elements of £6 , F(96) = £6 Then, F<SS) » 83*- £8 and £6*n F<£6) = F(93). There is no 
elemen* in F(S6) which is a factor of any of the elements of £S Hence, £6 is very 
thin code and every subset of it is also very thin 
DEFINITION 6 2 2 4 

A code X IS purely thin if and only if X*r) F(X) = FIX) 

PROPOSITION 6 2 2 7 

The code SS is purely thin 

PROOF The code £6 satisfies the condition £6*0 F(9S) = F(£6> So it is purely thin 
6 2 3 LITERAL REPRESENTATION OF £6 = 011*0 

Literal representation of codes over an alphabet is a convenient method of 
representing them graphically in the form of a tree whose selected nodes ( nodes 

which are shaded ) correspond to words in the code set 

Given a finite alphabet A, the literal representation of the corresponding 

free monoid is constructed in the following manner 

The alphabet is totally ordered and words of equal length are lexico- 
graphically ordered The set of words of a specific length form a level in the 
tree All the nodes of a level are lexicographically labelled from top to bottom 
The zeroth level consists of a single node known as the root corresponding to the 
null string. The first right level consists of n nodes where n is the number of 
symbols in the alphabet Labelling of these n nodes is done from top to bottom in 
accordance with the lexicographic order introduced in the alphabet. The second 
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right level consists of n nodes, each being labelled lexicographically from top to 
bottom with the corresponding n words of length 2 By repeating this procedure 
the literal representation of the free monoid could be potentially realized For 
example, the literal representation of the free monoid of the alphabet Xo={OI) 
IS shown in figure 6 2 3 1 



FIGURE 6 231. 


Literal represenUtion of the free monoid J. 


* 

o 


Since 9S IS a subset of ji its literal representation is a subtree of the tree 

0 

f 

of A The subtree corresponding to the code SG is shown in figure 6 2 32 [Note 
o 

The shaded nodes correspond to the words in SS 3 



FIGURE 6 2 3 2 Literal representation of the code 9S = Dll 0 
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The advantage of the literal representation of codes lies in the easy 
readability of words and compact diagrammatic representation of reasonably big 
codes Given a finite alphabet C C Subsection 6 2 11, the corresponding code set X 
IS also finite Now the literal representation of X yields a method for verifying 
whether the transcription of a normal algorithm ( which is nothing but a (0,D-chain 
from the code set 9G ) is actually in X or not In other words, the verification of 
a valid factor of the transcription of a normal algorithm is done by tracing the 
path from the root, letter bu letter so that a leaf ( shaded node ) is reached This 
procedure is repeated for all the factors of the entire coded string The 
successful completion of all such verifications corresponding to a given (0,l)-chain 
determines the syntactic correctness of the transcription of a normal algorithm 

6 3 THE NOTION OF A CVaiC NORMAL AUTOMATON 
The notion of an unambiguous automaton plays an important role in the study 
of variable length codes, in the sense that, computations in the monoids of 
functions are replaced by computations in the monoids of unambiguous relations 
DEFINITION 6 31 C61 

UNAMBIGUOUS RELATIONS 

Let us consider an N-relation [ Ref Definition 6 15 3 between two sets P and 

Q which IS a mapping m • PXQ ^ N where N is the corwlete semiring of natural 

numbers which admits least upper bound The N-relation of m is said to be 

unambiguous if m € £0,13^^^ where 0,1 € N Assume P=fQ Then a monoid M of 

QxQ 

unambiguous relations over Q is defined as a submonoid of £0,13 with the 
identity element Iq The following property holds for M 

V m,n6M p,o6Q 3 r€Q «p,mn,q)=l =» <p,m,r)=(r,n,q)=l) 

M IS transitive if it satisfies the following property 


V P,q€Gl 3 m€M ( (p,m,q) = OVl ) 
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Now, a monoid M of unambiguous partial order relations over a set Q is 
defined as a submonoid of with the identity Iq where 0 and 01 are the 

constructive natural numbers C Ref Subsection 51 ] corresponding to 0 and 1 
from N The system of constructive natural numbers is denoted by the symbol H 
A H-relation m is unambiguous only when m € CO, 01)*^^. 

Let us consider a normal algorithm ^ over an alphabet , whose scheme © 
consists of n substitution formulas As described in subsection 2.2., Jf is an 
)-class semi“Thue presentaion of the free monoid defined by a totally ordered 
Ust of n 3-class partial order relations corresponding to the n substitution 
formulas Now, one could construct n unambiguous H-relations corresponding to the 
n 3-class partial order relations of the scheme © This indicates the possibility 
of interpreting normal algorithms in terms of unambiguous automata 
DEFINITION 6 3 2- C63 

UNAMBIGUOUS AUTOMATA 

Let A be an automaton over an alphabet A Then, A is unambiguous if and only 

% 

if its representation ) is unambiguous I Ref Definition 615 3. Moreover, if 

x 

A = <Q,A,A> then A is trim if and only if ^y^<A ) is transitive 
DEFINITION 6 3 3 

NORMAL AUTOMATON 

This IS defined as a quintuple <X, Y, Q, X, S>, where X is the set of admissible 
inputs, Y IS the set of outputs, Q is the set of states corresponding to the number 

of substitution formulas, X is the next state function of the type X Q X X ^ Q , 

and 6 is the output function of the type S Q X X ^ Y and whose constructiott 

IS governed by the following rules • 

For any state Q let the input string be w^, and the left part of the 

corresponding i^^ substitution formula be u^ Then , 

a) X(qj, Wj) = Cq if u^ IS a factor of Wj^ , that is , u^ i w^ 
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( Qq is the initial state ) 

= otherwise 
(a) 5(qj, Wj) = Wq if a Wj 

( Wq is the input string at the initial state ) 

= Wi+i otherwise 

Definition 6 3 3 has been coined with the purpose of interpreting the scheme & 
of a normal algorithm JC over an alphabet A But, this definition does not fully 
characterize the class of normal algorithms O’ ar an alphabet A , based on their 
common operational semantics However, the following modified definition gives rise 
to a syntactic construction which describes the operational scheme of normal 
algorithms over an alphabet A 
DEFINITION 6 3 4 

CYCLIC NORMAL AUTOMATON 

This IS defined as a 7-tuple <X, Y, Q, q^^p, X, S> where X is the set of 
admissible inputs, Y is the set of outputs; Q is the set of n states corresponding 
to the n substitution formulas of the scheme © of a normal algorithm Jf over an 
alphabet A, 0^^!^ Q input state, q^^n^ Q is the output state, X is the next 

state function of the type X Q X X ^ Q and S is the output function of the 

type 6- Q X X ^ Y and whose construction is governed by the following rules 

For any state q^ , let the input string during the iteration of the scheme be 
and the left part of the corresponding i^^ substitution formula be uj^ 

Let us assume that the i^^ substitution formula is of simple type Then , 

(i) X(qj, w^^) = Qq if ( ) or - ( Uniwmn ^ 

{ Qq iS the first state ) 

= otherwise 

(ii) 5(q^, w^,) = If ( u,iw„i ) or - ( Un^Wmn > 

= w^d+l) otherwise 
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1 |U 

Let us assume that the i substitution formula is of terminal type Then , 

(1) w^i) = i^^^^i^Wmi^ 

=5 otherwise 

(ii) S(Q^, = y y€Y if ( u^^Wj^p 

= ‘^md+i) otherwise 

As an illustration, a 6-state cyclic normal automaton corresponding to a 
scheme consisting of six simple substitution formulas is shown in figure 6 31 



FIGURE 6 31 A 6-state cyclic normal automaton 
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We shall represent a cyclic normal automaton by the symbol <£ Then the 

representation associated with C is a morphism v<* ^ C0,0I3*^^® , 0,0 i € H 

such that the following hold 

(i) = Iq < identity element ) 

(ii) ( q^, Qj ) = 0I if there is an edge connecting and q^. 

= 0 otherwise 

Any cyclic normal automaton OE over an alphabet -A is unambiguous because, for 
every Qj € Q and Wj^^ € ^ , ( q^, ^^<Wjjjj), ) 6 {0,0D 

6 4 IMPLEMENTATION OF SIGNAL PROCESSING OPERATIONS IN TERMS OF 
REWRITING CYCLIC NORMAL AUTOMATA 

In subsection 5 3, it was shown that signal processing operations could be 
carried out by means of EPT rewriting systems Here, we show that such EPT 
rewriting systems can be modelled as finite state machines which we shall call as 
Rewriting Cyclic Normal Automata (RCNA) An RCNA is basically a cyclic normal 
automaton with certain additional factors 
DEFINITION 6 4 1 

REWRITING CYCLIC NORMAL AUTOMATA 

Let us consider a normal algorithm Jf consisting of n totally ordered 

substitution formulas £ u^ ► v^ i^i^n } and its EPT version We shall define a 

rewriting cyclic normal automaton for the EPT system in the following manner. 

Let Q be the set of states corresponding to the semi-Thue productions 
contained in the scheme of the EPT rewriting system where Q = tq^j I O^i^n-i , 

' 1 represents the i^^ substitution formula , 3 represents the j semi- 
Thue production of the i^^ substitution formula and k represents the number of 
states, that is, the number of semi-Thue productions corresponding to the i 

tH 

substitution formula} For convenience, the state corresponding to the i 
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substitutiton formula is termed as a major state and the states corresponding to 
the k semi-Thue productions of the i^^ substitution formula as minor states Let 
^1 ^ '^i ^ substitution formula Then, the number of minor states 


corresponding to the 

ith 

major state is 

given by the following rules 

(i) 

if 

lUil 

= 

IVil 

= tm > then k 

= 2t(n (NOTE |u^| is the length of u^ ) 

( 11 ) 

If 

luj 

( 

IVil 

then k 

= 2«m 

( 111 ) 

If 

lUjI 

> 

IVil 

then k 

= 2«m-l 


Now, the rewriting cyclic normal automaton is defineji as the triple < Q, INI, FIN > 
where INI gf Q is the initial state and FIN g Q is the final state and whose set of 
edges $F contains edges of the following types 

(i) djj — ‘^(i+DO ^ being in the state if the symbol u, is not 

found in the corresponding irput string, 
go to the next state 0(1 + -dq and read the 
same string ) 

(ii> ► '^lO+D ^ being in the state if the symbol it is 

found in the corresponding input string, 
recognize it as f and go to state ai(j+i) > 

(ill) q^ ( being in the state qj^^ if the symbol jtl is 

found in the corresponding input string, 
go to state qi(j+j_) and read the symbol 
next to a ) 

(iv) qpg ( being in the state q^ rewrite the input string 

With the recognized symbols duely subs- 
tituted and go to state ciqq ) 

We shall demonstrate the working of an RCNA by means of the following 


example 
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example 6 4 1 

Let us consider the EPT rewriting system corresponding to the cyclic shifting 

normal algorithm C Ref Example 5 3 2 2 1 

The RCNA for the above EPT system is defined by * <Q, INI, FIN> where 

Q = ^ ^00 ' ^01 ’ *^02 ' ^03 ' °>04 ' *^05 ' *^06 ' *^07 ' ‘^08 ' 

diO > <311 ' ^i2 ‘ ‘313 ' <314 ' <315 ' ‘3^6 , 

‘320 ' *321 ' ‘322 ' ‘323 ' ‘324 ' <325 ' ‘326 ' 

‘330 ' ‘331 ' ‘332 ' ‘333 ' 

<34q i q4i f d42 ' * 3.13 , 

‘350 ' ‘351 ' ‘352 ' *353 ' 

•360 ' ‘361 ' ‘362 ' ‘363 ' ‘364 ' 

‘370 ' *371 ' ^372 ' ‘373 ' 

<3so ' 

*390 ' ‘391 ' ‘392 ^ 

with the set of edges if where, 


if = f (qjNl ' 

E , qoo> / 

taflo ^ E\f/ ^ / ^10^ * 

<‘3m 

^/p j qpji^) , 

^‘301 ' 

fi/— 4 j ^02^ * 

(Qq 2 , E\a/«= , Q£q) , 

^^02 

oc^/T* f Qq3^ * 

^Cl03 ' 

r/— ^ 1 qq^) , 

(qQ4 1 ENtf/ ♦= t f 

<*304 

p/^ , qps) t 

%5 ' 

pit / — ♦ ; ^06^ ' 

(qQg / E\r/i= , q^p) , 

<‘306 

f r/c^ t ' 

(qQ7 < 

a/ *“+ , ^08^ ' 

^^08 ^ A/h f Qqq 5 } 

<‘310 

E\o^/ / q2Q^f 

<qi0 > 

CXt/P , , 

(qil ; ft/— 4 i ^12^ » 

<012 

Il\p/ i= f ^20^^ 

<‘312 ' 

p/r f * 

(qi3 1 r/-4 , qjL4) f 

<014 

Exr*/ i ^20^^ 

<‘314 ' 

r/a , q^5) 1 

(q , a/-4 f / 

<‘316 

F A/h # qpp) t 

(q20 ' 

T\&/ <s= t Q30^ * 

^^20 * * ^21^ ' 

<•321 

f a/-4 i ^22^ * 

<*322 ' 

T\p / <= > Q30^ > 

(Q22 * f ^23^ ' 

<‘323 ' 

} P/~^ * Q24^ * 

<‘324 ' 

A//3 , q25> > 

(q25 $ &/^ * ^26^ * 

<‘326- 

F A/f- j Qqq) > 

<<330 ' 

E\a/<s , a4Q) , 

(qpQ > c^/0 1 Q31^ * 

<031 , 

F jS/— 4 1 0(32^ ^ 

<‘332 ' 

EW^ , q4Q> , 

(Q22 > » ci33> 1 

(CI33 i 

. A/h f Qqq) , 

<‘340 ' 

EWir , qgg) , 

^^40 ^ * ^41^ ' 

<041. 

F r/-4 ^ ^{42^ * 

<042 ' 

E\j3/ «= ; <350^ * 

(042 f &/ A t ^43^ ^ 

<043 . 

F A/H t ^00^ * 

<*350 ' 

E\r/«= , q^q) I 

(qgg , r/r , qgj^) # 

<<351 ' 

1 r / — ► * ^2^ * 

<052 ' 

E\r/ *= , q^q) 4 

(qg2 f A f ^53^ ^ 

<‘353 ' 

^ A/H i QoO^ ' 
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(Qg2 ' 2\Wr/ p: , Q^q) I 

(ag4 f A/h I Qqq) i 

(q?! , /3/— 4 , ^72^ ' 
(Q*73 t A/h" t ^00^ * 
(Qgg t A/^ t * 


(Q^O ' ^ » 

(Q£2 * > 

^^70 * ^ f ^00^ * 

^^72 * ^ / ^00^ * 

^^80 * ♦= j. Qgg) t 

^Qgi I t C|g2^ > 


(^01 f i ^62^ ' 

(q^2 ^ f'/A ; 0 ^ 4 ) » 

(Qtpg , f ^7^^ f 

(^22 ^ ^/A / Q 73 ) # 
<090 i r/A / QpiH^ ^ 
(Q 92 ^ A/h* ^ ^ 00 ^ ^ 



FIGURE 6 4 1- Graphical representation of the rewriting cyclic normal auotmaton 
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PROPOSITION 6 4 1 

The family of languages recognized by Turing machines is also recognized by 
Rewriting Cyclic Normal Automata 

PROOF This IS a direct consequence of theorem 5 3 21 
6.4 1 PRINCIPLE OF NORMALIZATION OF AUTOMATA 

With a view to answering the question! in what measure does the precise notion 
of a normal algorithm relate to the less precise but more general notion of an 
algorithm in some alphabet, Markov proposed the principle of normalization which 
states 

Every algorithm in an alphabet J. is fully equivalent relative to some normal 
algorithm over A 1231 

This principle asserts that given a well defined algorithm in an alphabet A 
with a specific set of input output pairs, one can construct correspondingly an 
equivalent normal algorithm relative to that alphabet with the same set of ir^jut 
output pairs 

In what follows, we interpret this principle in terms of normal auotmata I Ref. 
Definitions 6 33 and 634 ] and a more general notion of a family of automata over 
an alphabet 

In 1701, Schutzenberger defines the notion of a family of automata over an 
alphabet in the following manner. 

DEFINITION 6 4 i i 

A family of automata 91 over an alphabet >4 consists of machines characterized 
by the following restrictions 

(i) Their output consists in the acceptance ( or rejection ) of input words 
belonging to the set F of all words in the letters of a finite alphabet A 

(ii) The auotmaton operates sequentially on the successive letters of the 
input word without the possibility of coming back on the previously read letters 



120 


and, thus, all the information to be used in the further computations has to be 
stored in the internal memory 

(ah) The unbounded part of the memory, Vn , is the finite dimensional vector 
space of the vectors with N integral coordinates, this part of the memory plays 
only a passive role and all the control of the automaton is performed by the finite 
part 

(iv) Only elementary arithmetic operations are used and the amount of 
computation allowed for each input lt'»vter is bounded in terras of the total number 
of additions and subtractions. 

(v) The rule by which it is decided to accept or reject a given input word is 
submitted to the same type of requirements and it involves only the storage of a 
finite amount of information 

It IS in this context, we propose the following principle of normalization of 
automata which relates the notion of normal automata with that of a family of 
automata 

Every automaton A belonging to the family of automata U over a finite 
alphabet A is fully equivalent relative to A to some normal automaton over A. 

This principle highlights the following conjecture 

Every family of automata over a potentially realizable alphabet is 
normalizable and therefore it is impossibile to construct a nonnormalizable 
automaton 

6 4 2 CONSTRUCTION OF FLOWER AUTOMATA FDR 
TRANSCRIPTIONS OF NORMAL ALGORITHMS 

Berstel and Perrin have described in 161, the construction of a tniversal 
automaton known as Flower Automston which recognizes a submonoid of A where A 
IS an alphabet The importance of this type of automaton lies in the fact that it 
allows a new state q* = (A, A) m its construction by virtue of which one could 
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describe any type of finite state machine as a flower automaton. The null string A 
IS the identity element of the submonoid which is recognized by it 

In this subsection, we show that transcripted versions of normal algorithms 
could be represented by such flower automata 

As shown in subsection 6 2 , the transcription of a normal algorithm Jf is a 
word over the biprefix code set 9G = 011*0 The characteristic series of S6 denoted 
by K IS given by ( ^ , x ) = 1 if xeSS 

0 else 

A trim automaton A CRef Def 6 1 33 with a unique initial and a unique final states 

IS unambiguous if and only if its behaviour lAI CRef Def 6 i 53 is a characteristic 

series Now let us construct an automaton Ajj(9G) = < Gl I, T> over the alphabet 

X X 

Ao = C O I 3 where Q = C (u, v) € A^XA^I uv € S8 3, I = AXSS , T = SSXA with 
edges of the type (u, v) — - — ^ (u', v') such that ua = u' and v = av' and uav € SS. 
The behaviour of this automaton |A£)(SG)| is equal to the characteristic series 8G 
A£,(SG) is unambiguous and it recognizes SG Now we define the flower automaton for 
the transcription of a normal algorithm in the following manner - 

DEFINITION 6 4 2.1 

The flower automaton for 9S is defined as the trim part of the automaton Bq( 9S) 
derived from Aq(SS) using the canonical construoticn given in definition 617. The 
introduction of a new state q^ = (A, A) m the construction of Bj^jCSS) allows only 
four types of edges in the flower automaton 


(i) (u, av) 

(11) (A, A) 
(ill) (u, a) 
(iv) iA, A) 


^ (ua, v) 
^ (a, v) 

^ (A, A) 
^ (A, A) 


for uav € SS 
for av € SS 
for ua 6 SS 
for a € SS 


and (u, v) ^ 
and v^ 
and 


(A, A) 

A 


u^ A 



EXAMPLE 6 4 2 1 
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The flower automaton corresponding to the transnption OIQOilOOIIIOOIIIIO is 
shown in Fig 6 4 2 1 



FIGURE 6 4 2 1 The flower automaton corresponding to the transcription 

OlOOIIOOlilOOIIilO 

PROPOSITION 6 4 2.1 

To each cyclic normal automaton we can associate a flower automaton 
PROOF 

It IS a direct conseauence of their respective constructions and the 
transcribability of normal algorithms 



PART - III 



SECTION 7 


THE LOGIC OF CONSTRUCTIVE SIGNAL PROCESSING 

The purpose of this section is to study constructive signal processing 
systems in the framework of a oonstructii/e logic introduced by Markov C593, £603, 
[6i3> [623, [633, C643, C653 This constructive logic is built on a heirarchical system 
of languages denotri by = 0> 2, 3, 4, 5, . , u, ul , whose mam constituents 

are alphabets, u'ords and normal algorithms 

We first present a summary of the basic notions of this logic that are 
relevant for us and then introduce a theory Th(K) for constructive signal 
processing In later sections, we make use of this theory in the study of 
constructive systems in terms of homorphisms and extended topological filters 

7 1 THE LANGUAGES CHa) 


7 11 LANGUAGE Hq 

The starting point of Markov's logic is the language Hq A Liter aid is a 
nonempty word from a one-letter alphabet Variables are nor^mpty words from a 
one-letter alphabet Literoids and variables are also known as atoms, yerboids are 
formed by concatenating literoids to verboids The null string A is a verboid By a 
term we mean either a verboid or an atom Let us assume that there occurs a 
variable X in a term U Substitution of the variable X by another term T is a 
permissible operation By an operation, we mean the action of a normal algorithm 
on a term The result of the operation of substitution of X by T in U by means of 
a normal algorithm Jf, is also a term and is denoted by IflXUOTJ where □ is an 
auxiliary symbol and the symbols t and J play the role of the left and the right 
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parentheses respectively For example, for any term T, SFIXAOTJ s A where the 
symbol s stands for eaual by definition. The notion of result of the operation of 
substituion could be extended to all the remaining languages 

An elementary formula is a string of the form To^U where T and U are terms 
and IS a comparer By a comparer, we refer to any one of the symbols s, or ^ or 
= or ^ where the symbols = and 9^ compare two terms and the symbols = and ^ 
compare two words or verboids 

The only logical connectives thiat are permitted in flg are (i> & (conjunction) 
and (ii) V (disjunction) The quantifier symbols V and 3 are allowed in a 
restricted manner Quantifiers and connectives are called logical symbols 
Formulas of are constructed using the following rules 

(I) If A IS an elementary formula then it is a formula of Hg We shall designate 
a formula of as FmO 

(II) If A and B are FroO's and X is a comective, then XAB is an FmO 

(iii) If A IS an FmO, Q is a quantifier, X is a variable, U is a term and 0 is a 
limiter ( either the symbol < or the symbol } ), then the string QUjSXA is an FmO. 

The variable X is allowed to be substituted only by certain words or verboids 
For example, the formula VU<XA where U is a constant term, expresses that every 
formula of the type SfgLXAQJ is true where Q is the verboidal prefix of the meaning 
of U Three items are to be explained now (1) Constant Term' It is either the null 
string A or of the form PQ where P is a constant term and Q is a literoid (11) 
The meaning of a constant term is' always a verboid determined by a normal 
algorithm (111) {ToLXACJJ is the result of substituting the variable X by a term Q in 
the formula A which is also a formula To be more specific, the quantification in 
an FmO is to be understood as that which allows the bounded variable to range in a 
predetermined, bounded set of words or verboids only 

The notion of a parameter is important in constructive logic. By parameters 
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we mean the variables that occtff' either in an elementary formula or in the 
formulas A and B contained in the formula XAB or in U and A of the formula QUjSXA 
excluding X The term parameter conveys the same meaning as the term free 
i/sriable conveys in classical logic 

As a result, we have the notion of a closed formula in constructive logic 
similar to that of a sentence in the classical logic 

In general, a closed formula of a language fia. is a formula without parameters 
as defined in Sa Closed formulas of a language fia are de ignated as CFa's The 
set of all formulas of a language Ha is denoted by {Fma) and the set of closed 
formulas by CCFal CCFal is a subset of £Fmcc} So, CCF03 is thie set of all closed 
formulas in the language 5 Iq and it is a subset of CFmOl 

The language Hq does not allow the direct use of a negation symbol in an FmO 
However, it is riossible to obtain an FmO which is semantically a negative 
equivalent of another by means of a normal algorithm ^ whose scheme is given 
below 



Substitution Formula 


Formula Number 


«€ 


fa 


a= 

a,=z 

aSc 

«V 

aV 

a3 

a 



a 


(f denotes 
every 

symbol of Bq 
other than =, 
= and ^ ) 


< 00 ) 


( 01 ) 

( 02 ) 

(03) 

(04) 

(05) 

(06) 

(07) 

(08) 

(09) 

(10) 
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transformed to Q by Jf 

(vi) <x=»* y)jf IS an Fml without parameters different from x and y such that 

2f j[lx(x=»" y)j^[P3'^J[Q]"^J is a valid CFl provided P is ooncludingly 
transformed to Q by Jf 

(vii) (x y=»z)j^ IS a valid Fml without parameters different from x, y and z so that 

Ef j^lySf j_lx(x y=»z)CJf3JtQ3'^jtR3*^J is a valid CFi provided the s/erboid 
which IS the translated version of the word Q from f 0 I 3 , is 

tr ansf ormed to the verboid [R]^ when the transcription of Jf is 
applied to it 

An important notion that introduces is the calculus <£ , which iS based on 
the notion of deducibility of a CFl from another. Let S be a finite series of CFl's 
(that IS, a finite number of CFl's are written one after the other in the form of a 
string) Now we shall call a CFl C as an immediate consequence of S only in the 
following cases (i) if there is a valid CFO, (ii) if A and B are in S such that 
C = &AB, (ill) if either A or B is in S such that Cs= VAB and (iv) if ff^lXDQj is in 
S such that C = 3XD Now the notion of deducibility is to be understood in the 
following manner If S is a deduction and a series of CFl's and C is an immediate 
consequence from S then SC is a deduction Obviously the null string A is a 
deduction In general, the notion of deducibility is extended to all the remaining 
languages, in the sense that, for every language Ra there is a system of rules of 
deduction S® using which a CFa could be deduced from another C323 

713 LANGUAGE fig 

The language is richer than in the sense that, it provides rules for the 
use of implication and negation of 0^^ order and unii^ersal quantifier in 
constructing Fm2's. Implication is denoted by the symbol o 
An Fm2 is constructed using the following rules 
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(i) If A IS an Fml then it is also an Fm2 

(ii) If A and B are Fml's then oAB is an Fm2 

(ill) If A and B are Fm2's and one of them is certainly not an Fmi then &AB is an 
Fm2 

(iv) If X IS a variable and A is an Fm2 then VXA is an Fm2 

It IS important to note that CF2’s cannot be combined using the logical 
connective of disjunction. Also existential quantifiers cannot be used in the 
construction of Fm2's 

Fm2's of the form oAB where A and B are Fml's are called implications of the 

1 l_ L U 

order The implication of the order is to be understood in the following 
manner Let S be a series of Fml's Let A and B be two Fml's. Then the Fm2- oAB is 
interpreted as for an arbitrary S, ((S is a deduction of A) or B) 

The negation of the 0^*^ order is defined as -'A a A(?6) where A is an Fmi. 

The following are the basic deductive rules of the language • 


f,) A oAB 
B 


fill pAB dBC 
dAC 


( 111 ) 


B 

oAB 


(iv> 


oAB oAC 
oASiBC 


(V) 


oAC oBC 
oVABC 


(VI) 


D E 
&DE 


(vii) 


(viii) 


ax) 


af 2 LJfHQJ for every verboid (3 
__ 


(x) 


VXH 


(xi) 


VXoGA 

03XGA 


In addition to these rules, ^2 Pr'o^ides a semiformal system S2 consisting of 
thirteen rules of deduction which decide the deducibility of a CF2 from another 

Let K be a CF2 Let Y be a condition which could be meaningfully in^osed on a 
CF2 Then Y is called K-inductu^e if the following thirteen conditions hold: 

( 1 ) K satisfies Y 


( 11 ) Every valid CF2 satisfies Y 
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(ui) Whenever the CF2's A and aAB satisfy Y, B satisfies Y 

(iv) Whenever the CF2's dAB and dBC satisfy Y, then dAC satisfies Y 

(v) Whenever the CF2 B satifies Y, then dAB satisfies Y 

(vi) Whenever the CF2’s oAB and aAC satisfy Y, then sA&BC satisfies Y 

(vii) UBnenever the CF2's dAC and aBC satisfy Y, then oVABC satisfies Y 

(viii) Whenever D and E satisfy Y, then the CF2 &DE satisfies Y 

(ix) Whenever the CF2 &DE satisfies Y, then the CF2 - D satisfies Y 

(x) Whenever the CF2 &DE satisfies Y, then the CF2 • E satisfies Y 

(xi) Whenever Me have a general method enabling us to establish for fixed 

X and H and for any verboid Q that the CF2 |if 2 lXHQJ satisfies Y, then 
the CF2 VXH satisfies Y 

(xii) Whenever the CF2 VXH satisfies Y, then the CF2 iy 2 l-XHQJ satisfies Y 
(xiii) l^enever the CF2 VXdGA satisfies Y, then the CF2 o3XGA satisfies Y. 
THEOREM 7 13 1 [613 

If a condition Y is K-inductive, then every CF2 which is deducible from K 
satisfies the condition Y 

714 LANGUAGE 

This language is just an extension of Jl 2 sense that it provides rules 

for the use of implication and negation of the first order They are denoted by 
the symbols d| and -“I respectively 

An Fm3 is constructed using the following rules - 

(i) If A IS an Fm2 then it is also an Fm3 

(ii) If A and B are Fm2’s then o|AB is an Fm3 

(ill) If C and D are Fm3's such that one of them is certainly not an Fm2, then &AB 
IS an Fm3. 

(iv) If X IS a variable and E is an Fm3 but not an Fm2 then VXE is an Fm3. 
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The negation of the first order is defined as -|B s d|B(? 4) where B is an Fm2 
theorem 7 14 1 [34] 

where A is an arbitrary Fml -A is a quasi elementary formula since -A 
IS nothing but oAC^i) 

The above theorem is known as Markov's Principle of Constructive Choice 
Let K be a CF3 and Y be a condition which could be meaningfully imposed on K 
Then Y is called 3K!-inductive if thirteen conditions similar to the ones given in 
^2 hold h, iw, if Y IS 3K-inductive, then every CF3 which is 3-deducible [ Rt 
deducibility of CF2's 3 from K satisfies the condition Y The notion of K-induction 
could be extended to all the remaining languages in a similar manner. 

715 LANGUAGES R 4 , % , . 

The languages and so on, are the generalizaticre of the successively 

extended languages Hq, fl^, ^2 ^3 language after R 3 is identified by Rjq 

N = 4,5,6, with the corresponding system of deductive rules Sjq N = 4,5,6,. . 
For every transition from a language to its successor , a new kind of 
implication emerges, an implication of order N-1 Thus a language accumulates 
implications of orders 0 to N-2 However such an abtxidance of implications does 
no harm since they agree among themselves 

An FmNI is constructed in the strength of the following rules 

( I ) If A IS an FmN then it is also an FmNI 

( II ) If A and B are FmN's then o(N-l)AB is an FmNI 

(ill) If C and D are FmN I's such that one of them is certainly not an FmN, then 

&CD IS an FmNI 

(iv) If X is a variable and E is an FmNI but not an FmN then VXE is an FmNI 

N l-deducibility and N IK-induction are defined in exactly the same manner as 
they are defined in the previous languages 
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In general, the negation of order N in the language is defined as 
-’NA s 3NA(#) where A is an FmNI 

THEOREM 7 15 1 [353 _iiJ^ (Proof is ommited here ) 

7 16 LANGUAGE flu 

The notion of abstraction of potential realizability 1233 allows one to unite all 
the languages so far seen, to form what is known as flu 
An Fmci) is constructed as per the following rules 

(i) If A IS an Fml then it is also an Fmo) 

(ii) If C and D are Fmu's and one of them is certainly not an Fml then &CD is an 

FMo) 

(ill) If E and F are Fmco's then oEF is an Fmu 

(iv) If X IS a variable and E is an Fmu then VXE is an Fmu 

Fmcj's are known as normal formulas Two Fmw's cannot be combined 
disjunctively nor they be existentially quantified However, flu allows the use of 
quasi disjunction and quasi existential quantifier in the construction of Fmu's We 
shall denote quasi disjunction by the symbol V and the quasi existential quantifier 

by the symbol 3 and agree to their definitions as given in C643, so that the 

following hold 

(i) y AB s -&-A-B where A and B are Fmu's. 

(ii) 3 XA ^ -'VX-A where X is a variable and A is an Fmu. 

717 LANGUAGE fl^^, 

This language is an extension of flu and is closed under all traditional logical 
connectives 

Fmul's are constructed by virtue of the following rules 
(i) If A IS an Fmo) then it is also an Fmul 

(li) If A and B are Fmul's but one of them is certainly not an Fmu and X is a 
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logical connective either d or & then XAB is an FukjI 
(ill) If A IS an FmtJl but not an Fmu and X is a variable then VXA is an Fmul 
(iv) If A IS an Fmcjl but not an Fmi and X is a variable then the string 3XA is 
an Fmwl. 

The language is a sublanguage of For any two Fmol's A and B in which 
one IS certainly not an Fml the disjunctive formula VAB is defined as VAB s 
3 z&o(z=)Ao(Z 9 t)B where z is a variable other than the parameters of A and B 

The negation is defined as -A ^ oA(^) where A is an Fmol. 

The rule Modus Ponens holds here Whenever the CFwI's A and B are such that 
both A and oAB are true m then B is also true in fly| 

The principle of constructive choice is stated in as oVXVB-Do— '3XD3XD 

The above principle plays the fundamental role in the formulation of a 
constructive theory for signals and systems as we shall see in the next 
subsection 

72 NORMAL ALGORITHMIC SIGNAL PROCESSING SYSTEMS REPRESEtTTED BY 
A MODEL CjK OF A CONSTRUCTIVE THEORY Th«B) 

Let {CFa} be the set of closed formulas of a language % . Following standard 
terminology £33, any subset of £CFa} is a constructu^e theory, fa , of that language, 
and a structure M is a model of the constructive theory fa -if svery closed 
formula of the theory holds in M 

Consider now a constructive theory, Th<!B), defined by the following five closed 
formulas that are Ry|-provable 


Th(«) 


(i) Fmul 1 

O-'-IJflPJIJfl.PJ 

(ii) Fmo)! 2 

3JflPJ*Q»JTLPJ 
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(ill) Fmul3 DVxyzSfji IzSfj^lySfj^Wx y=»z){«)rj}J[P3'’’jCQ3'’’j= 

0filzafily«Sf j^lx(x y=»z){Jrj}jCP3'''j[(53'^JC,)fp sifJfj) 

(iv) Fmu>l4 DVXYZ&&>N'jLXJ«YJrjLYJ=ZJf^,LXJ=ZJfjLJrjlXJJ=if,^lXJ 

(V) FmwlS 3VXYZ&&>fjLXJ=YJfjlXJ=ZJf|^lXJ=YZJfJXJJfjlXJ=Jf,^lXJ 

Now, we denote as C<^ , the class of signal processing normal algorithms and 
show that is a model of ThO?) 

Fmul.i IS a different version of Markov's principle of constructive choice 
According to this principle, if the assertion o^ the inapplicability of a normal 
algorithm Jf to some specific word P is refuted then Jf is applicable to P By 
applicability definiteness of a normal algorithm Jf to a string P, we mean the 
effective use of atleast one of the substitution formulas of the scheme of Jf in 
rewriting P The applicability definiteness (a-definiteness) of Jf to P is generally 
expressed as <Jf(P) The basic supporting argument underlying Fmui 1 is the notion 
of abstraction of potential realizability By virtue of this notion, if the 
antecedent -"-iJfLPJ is accepted then the process of applying Jf to P cannot 
continue forever and so it is possible to obtain the result of applying Jf to P by 
actually carrying out the operation of this algorithm step by step waiting for the 
conclusion of this operation Since computation time and storage space are not 
considered to be the limiting factors in carrying out normal algorithmic signal 
processing operations, the formula Fmul 1 holds for C<kj 

Fmtol 2 IS interpreted in the following manner A normal algorithm .^f is said to 
be a-definite for a word P only when Jf is applicable to P and the process of 
applying it to P terminates naturally or by a terminal substitution formula and the 
output Q IS a word other than P An important question that arises here is of 
immediate concern to us. Does Q indicate the desired output in JflPJssQ of the 
formula Fma)l.2 ? The answer is negative, due to the fact tlie a-definiteness of a 
normal algorithm for a word does not guarantee the transformed word to be the 
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desired output due to the intended operation for which the very scheme has been 
constructed For example, let us consider a normal algorithm Jf over an alphabet 
whose scheme is constructed with the purpose of carrying out a specific 
operation on words from J, Let us assume that this scheme contains the simple 
substitution formula ^ ct Then ■K is a-definite for every word in the free 
monoid »A But a-definiteness of ^ to the free monoid does not imply that every 
word of the free monoid is transformed to the relevant output due to the intended 
operation In order to overct <tte this difficulty, we shall introduce here the notion 
of successful applicability of a normal algorithm 

A normal algorithm Jf is said to be successful applicability definite (sa- 
de finite) for a word P only when the result of applying Jf to P is the desired 
output that satisfies the purpose for which the scheme of Jf has been constructed 
sa-definiteness of a normal algorithm implies its a-definiteness. But the 
converse is not true always We shall explain this by means of an example. Let us 
consider the alphabet A 2 = iO \ - /) A word Q from this alphabet is said to 
represent a valid rational number q if Q is of the form R/S, where, R and S are 
words that represent integers An integer is a word 0 or any word made up of the 


only letter I with or without the symbol - left adjoined to it For example, the word 

INV 

-III represents the integer -3 The normal algorithm Jf^ whose scheme is given 
below, IS sa-definite for every valid rational number q of the form R/S in the 


sense that, the result of its application to Q R/S is the desired output S/R 


INV 

Jf 


Q 


substitution formula formula number 



(00) 

(01) 

(02) 

(03) 

(04) 

(05) 

(06) 

(07) 

(08) 
(09) 
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all 

al/ 

a/I 

iS 



(10) 

( 11 ) 
( 12 ) 

(13) 

(14) 


Let us consider two strings Q = -Ill/Il!l and Q' = -111/ and apply to Q and 

INV IMV 

Q' independently Now, (-111/1111) = -llll/lll So, Jf is sa-definite for Q On the 

INV ® IfsIV 

other hand, Jf_ (-111/) = -/III This proves that Jf is certainly a-definite 
W Q 

but not sa-definite for Q' 


Since all constructive signal processing operations of our interest consist of 
normal algorithms which are sa-definite for input strings corresponding to 
admissible signals, proposition 7 2 1 is true for C(^ This means Fmul 2 is valid 
for Cgj 

Fmul 3 describes the operational equivalence between two normal algorithms Jf ^ 

and Jf j over an alphabet A, when the result of the operation of Jf ^ on a word P is 

the same as the result of the operation of Jfj on the same word P More precisely 

Fmwl3 IS read as if the result of the operation of the transcription of a normal 

algorithm X, in A on a word P from an alphabet A, transforming the translated 
o 

f I 

i^erboid of P in A into the translated t^erboid of Q in is graphically eoun^alent 
o o 

to the result of the operation of the transcription of a normal algorithm in A^ 

on the same word P transforming its translated i^erboid into the same translated 

i^erboid of Q in A , then the transcripted u'erboid of X, is operationally 

o 

ecfuii^alent to the transcripted i^erboid of X^ 

Using Fmu)l 2 we obtain two formulas from FmwI.S (i) DJfjLPJ=Q’Jfit.PJ and 
(ii) 3Jf,LPJ = Q IJf.LPJ Now, one can construct another normal algorithm Jf|^ over 
vtUC*} such that the formula X^^LX^LPMXJLPJJ=A is valid only when X^ and Jf, are 
functionally equivalent Fmwl 3 asserts that a particular signal processing 
operation could be realized by any one of the functionally equivalent constructive 


systems This allows us to name a constructive signal processing system pertaining 



to a particular operation by an abstract label For example, let us agree that the 
abstract label SB refers to a constructive system which implements linear 
convolution of nonnegalive integer sequences This does not mean Uiat 
refers only to the scheme given in subsection 4.2 Thus we see that Fmol 3 is valid 
for Cj, 

Fma)l4 and FrnwIS describe the operations of composition and union of normal 
algorithms respectively Already in subsection 2 3 3 and in section-4, we have seen 
how various signal processing operations could be realized by means of 
constructive systems consisting of normal algorithms combined in an admissible 
manner by virtue of composition and union theorems So, Fmo)l4 and FmolS are valid 
for Cjyj 

Thus, with Cjjj as a model of Th(9}), we now have a formal basis for the study of 
the structural properties of Cg^-type constructive signal processing systems 



SECTION 8 


HOMOMORPHISMS IN THE THEORY OF CONSTRUCTIVE SIGNAL PROCESSING 

Homomorphxsms play an important part .n the study of systems One of the 
important functions of homomorphisms is that they allow us to connect the results 
of one class of systems to those of an apparently different class of systems. A 
typical example of such connection to oe found in classical systems theory is that 
provided in Steiglitz C74], where it is shown that the theory of continuous- time and 
discrete-time systems are connected to each other through a homomorphism induced 
by the bilinear transformation between the Hilbert spaces oo> and t 2 <-co, <») 

What such a homomorphism essentially shows is that certain operations, relations 
and statements relating to these operations and relations are preserved under a 
particular mapping from L®(-oo, oo) to tzi-oo, oo> 

One important question that arises about homomorphisms in general is' Are 
there any general conditions that operations and relations and statements 
involving them must satisfy so that they are preserved under homomorphisms ^ One 
way to deal with this question is that of Lyndon 1583 who handles it in the 
framework of logic and algebra 

Since we are dealing with the notion of signals and systems in logical terms, 
Lyndon's results are directly relevant to us In this section, we reformulate 
Lyndon's homomorphism theorem in terms of constructive mathematical logic and 
investigate its applications for normal algorithms and constructive signal 
processing systems 

We begin by listing out in the following subsection 8.1, a few relevant 
properties of various Cjj-type constructive signal processing systems Later we 
refer to this list. 
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8 1 A SHORT LIST OF CONSTRUCTIVE LOGICAL FORMULAS 


Table 8 11 


PERTAINING TO THE MODEL Cjj 


SI No 

Properties of Cj^ relative 
to an alphabet 

constructive logical formula 

01 

Associativity of words/verboids 
under concatenation operation 

C Let Jf*^ be the normal algorithm 
which i>'ruld concatenate a word 
to anot. ar 3 

VXYZif °l>f^LXYJZJ = Jf'lX^f^LYZJJ 

02 

Concatenation of the identity 
element ( A ) to a word 

VXJf°lXAJ=Jf*^lAXJ=X 

03 

Definition of the relation V is a 
factor of X 

[ relation symbol 3 

3VX3UVW0C=UVW)V:iX 

04 

Reflexivity of the relation d 

VX(XiX) 

05 

Antisymmetry of the relation 

1 

3 VX Y&CX iriYKY = Y) 

06 

Transitivity of the realtion :i 

3 VXYZ&(X riYXY :£ZKX :^Z> 

07 

Definition of the relation V is a 
proper left factor of X 
[ relation symbol < 3 

t In general, the relation left 
factor of IS denoted by the 
symbol ^ 3 

3 VX3VW&(X=VWXW ;iAXV<X) 

08 

Transitivity of the relation < 

3 VX YZSXX < YXY <ZXX <Z) 

09 

Definition of the relation W is a 
proper right factor of X 
[ relation symbol- > 3 

3VX3VW&(X=VWXV g6AXW>X) 

10 

Transitivity of the relation > 

3VXYZ&<X>YXY>ZXX>Z) 

contd- 















11 


Definition of the relation of 
comparability of left factors 
[ relation symbol K 1 


D0VX3VW&(ViX)(WiX) 

V<ViW)(WiV)<V^W) 
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Symmetry of the relation 

oVUV(U^VKVKW) 

Transitivity of the relation X 

0 VUVW&(U ^V)(V KWXU KW) 

Definition of the relation of 
graphical equu'alence 
[ relation symbol = 1 

oVXY&oVZCZiXXZ^Y) 

oVZXZ'iXXZ'iYia .Y) 

Reflexivity of the relation = 

< 

>< 

11 

X 

Symmetry of the relation = 

DVXYa=Y)(Y=X) 

Transitivity of the relation 

D VXYZ&(X = YXY =Z)0( =Z) 

Definition of the eQUidiu'isibility 
of a free monoid' 

3VW'3WW'&(VKV'KVW=V'W') 

V3S(V=V'S)3T(V'=VT) 

Inyariance of words/i^erboids by 
the operation of double inversion 
[ Let Jf" be the normal algorithm 
which would invert a word 3 

VWJf~LJf~LWJJ=W 

Inversion of concatenation of two 
wordsNverboids is the reverse 
concatenation of their inversions 


Inversion of a proper left factor 
of a word/verboid corresponds 
to the proper right factor of the 
inverted word 

3VVW(V<WXJf~lVJ>Jf''lWJ) 

Definition of the conJugacy 
relation between two words 
[ relation symbol < 1 

0 VXY& 3VW(X ssVWXY =WVXX4Y) 




Reflexivity of the relation <J 


oVXO(<lX) 


contd.. 
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24 

Symmetry of the relation < 

oVXY0(<]YKY<jX) 

25 

Transitivity of the relation <3 

3 VXYZ&(X<1Y)(Y<JZ)(X0Z) 

26 

Definition of the relation 
elementary transformation of 
between two words/verboids 
by virtue of a normal algorithm Jf 
t relation symbol hj^ 3 

33VWVXY(JflXYYJ=XWY)(VhjfW) 

27 

Reflexivity of the relation f-f. 

VXOChj^X) 

28 

Antisymmetry of the relation hjif 

3 VXY&(X 1 - YXY h jfXXX = Y) 

29 

Transitivity of the relation 

D VXYZ&(Xh“j^Y)(Y \r j^Z)(X}— 

30 

Definition of the relation 
transformation of between 
words/verboids by virtue of a 
normal algorithm JC. 

[ relation symbol hjiP 3 

3VXYJflXJ=Y(XhjfY) 

31 

Reflexivity of the relation i=j^ 

VX(Xhj^X) 

32 

Antisymmetry of the relation 

3 VXY&<X 1= YXY h j(>XXX = Y) 

33 

Transitivity of the relation hjj' 

D VXYZ&(Xhj(>YXYJ= j(.ZXXf=j<>Z) 

34 

Definition of the relation 
contiguity of betweeen words/ 
verboids by virtue of an 
associative calculus A. 
t relation symbol 

0 3VW VXY ViftLX WJ =XWY) 

(ftLXWYJ=XVYXVXj^W) 

35 

Reflexivity of the relation 

VX(Xl^X) 

36 

Symmetry of the relation Ijj 

dVXY(XIjjYXYIj^X) 



contd. 
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37 

Transitivity of the relation JLj^ 

0 VXYZmijjYXY Ij^ZKX l^Z) 

38 

Definition of the relation 
a-defined eQui^alence of 
between words/verboids by 
virtue of an associative calcu- 
lus ft [ relation symbol 3 

DVXftLXj=Y(XJ_Lj^Y) 

39 

Reflexivity of the relation ±±|^ 

VX(XlijjX) 

40 

Symmetry of the relation J_Lj^ 

oVXY(XJLLj^Y)(YlijjX> 

— — 1 

41 

Transitivity of the relation JJLj^ 

0 VXYZ&CX ll^YXY Xlj^Z) 



(Xlij^Z) 

42 

Universal applicability of the 
identity normal algorithm 
[ Ref subsection 2 3 2 3 

1 

j 

VXlf®LXJ=X 

43 

Universal inapplicability of 

NL 

the empty normal algorithm >f 
[ Ref subsection 2 3.2 3 

-’iVXJf^lXJ=X 

44 

Universal applicability of the 
cyclic shifting normal algorithm 

Jf C Ref subsection 4 113 

ivxjf^ixj 

The 

formulas given in table 811 are from 

different languages of iHcc)> and 


they are -provable. 


8.2 A CONSTRUCTIVE REFORMULATION OF LYNDON'S HOMOMORPHISM THEOREM 
AND ITS IMPACT ON THE MODEL THEORETIC STUDY OF Cgjj-SYSTEMS 


Lyndon's homomorphism theorem (LHT) asserts that if SU is a classical 
algebraic system, P is a first order property true in 31 and 4>p is the defi 9 
logical sentence of P in the classical first order predicate calculus, then P is 
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true in all the homomorphic images of ai if and only if is a positive sentence 
[46], [581 

Now, the problem of our immediate concern is how to use Lyndon's 
homomorphism theorem in studying various properties of the model Cyj We shall try 
to solve this problem by giving a constructive interpretation of Lyndon's 
homomorphism theorem (LHT), and for its application to various constructive 
models 

To arrive at such an interpretation, we involve Markov's important result [661 
that every closed formula is fly-valid, and that a closed predicate formula 

(constructive sentence) is deducible in the classical predicate calculus if it is 
valid either in ^2 or in fly The converse form of this result is that for every 
sentence that is constructed in the classical predicate calculus without using the 
axiom of choice and the law of excluded middle, there is a closed predicate formula 
which IS fl 2 -valid or fly-valid Thus, if we are able to show that for the sentences 
that constitute Lyndon’s there are corresponding fl 2 or fly-valid closed formulas, 
then we get an interpretation of Lyndon's theorem that we are working for 

Now examining the standard statement of Lyndon's theorem, the only term that 
calls for special attention is the term 'first order property' For languages of fla 
we interpret this term as follows We first, call a closed formula that expresses a 
property of a constructive system as a Defining Constructive Sentence (DCS). A 
DCS IS called positive if all of its predicate symbols and normal algorithmic 
operations occur positively By a first order DCS, we mean a constructive 
sentence (closed formula) in which quantification is done only on words and 
verboids 

With these clarifications, we are now in a position to proceed towards 
interpreting Lyndon's homomorphism theorem in the following manner 
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8 2 1 FUJIWARA'S VERSION OF LYNDON'S HOMOMORPHISM THEOREM 

Lyndon formulated the homomorphism theorem with the help of his Interpolation 
Theorem which is a generalization of Craig's modified version of Gentzen's 
Extended Hauptsatz of Herbrand's theorem [40], [57], [58] 

A simpler proof for the homomorphism theorem was given by Keisler in his 
paper entitled Theory of models with generalized atomic formulas [53] The notion 
of generalized atomoic (G/i) formulas was introduced fay him in order to further 
generalize model theore ic concepts of subsystems and homomorphisms which are 
natural generalizations of various notions of modern algebra As a result, more 
generalized notions such as F-subsystems and F-homomorphisms appeared when a 
set of atomic formulas were replaced by a GA-set of formulas The following 
definitions are useful in order to understand Keisler's version of Lyndon's 
homomorphism theorem. 

DEFINITION 8 2 i.i [531 

A set F of formulas of a first order language L with identity, is generalized 
atomic (GA) if the following conditions hold 

(i) If f(Xj^, X 2 , X3, . , Xn) € F and x^, X2, X3, , Xn are mutually distinct, then 

(1) for any variable y^ of L , f (y^, X2. X3, , xp) € F \ closed under 

(2) for any constant k of L , f(l<, X2, X3, Xn) € F f substitution 

(11) f e F and f- f s g implies g € F <closure with respect to logical 

equivalence.) 

(ui) xj^=X2 € F (where Xj^ and ^2 are distinct variables ) 

(iv) The identically false formula OE F 
DEFINITION 8 2.1.2 [533 

Let F be a GA set Then, 31 is said to be an F-subsystem of 9S if (i> the carrier 
of 31 IS the subset of the carrier of 5B , that is , ACB and (11) for any f€F , 
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n-tuple <aj^, a2» ^3, , an> € An satisfies f in 9J if and only if it satifies f in 93 
DEFINITION 8213 [531 

A map h from B onto A is said to be an F-homomorphism from ® to 91 if 
whenever f €F and an n-tuple b2, b3,. . , bn> € Bn satisfies f in 93 , <hb£, hb2, 

hb3, . , hbn> satisfies f in 91 Then 9J is called an F-homomorphic image of » 
DEFINITION 82 14 tlSl 

The triple <R, F, H> is said to be a signature of an algebraic system if the 

follomng conditions hold (1) RnF=^ and (ii) U RUF 1 N (set of natural 

numbers), where R is the set of relations or predicate symbols, F is the set of 
operation or function symbols , jU is the place or arity mapping 
DEFINITION 8 2.1 5 1131 

An algebraic system 91 of a signature <R,F,y-> is an ordered pair < A, 1^ > where 
A IS the carrier and 1^ is known as the interpretation of the signature in A , 
which IS understood in the follCMing manner 1^ is a mapping of the set RUF 
into relations and operations on the set A Similarly, if f€F then, i^(f) is a 
li(r)-placB relation on A Usually, i^(r) and i^(f) are written as r^ and f^ 
DEFINITION 8 2 16 1531 

Let us consider two algebraic systems 91 and S with their respective earners 
A and B Let U be any interpretation in 91 and X be a unique interpretation in 93 
such that II and X agree on all variables of the language L Then. 93 is defined as 
an elementary extension of 9J if for all M and X and a formula « of L , if ^ holds 
in U then it holds in X also Let F be a GA set Then, given two systems 91 and 93 we 
shall say that IB is an F-extension of 91 only when 91 is an F-subsystem of 

Keisler's generalized form of Lyndon's hofftomorphism theorem is as follows 

THEOREM 82 1.3 t533 

Given an L-system IB and a GA set F An L-system 91 has an elementary 
extension which is F-homomorphic to an elementary extension of IB if and only if 
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every sentence positive in F »^ich holds in 95 also holds in 9J 
[ NOTE L refers to the first order language of the classical logic 1 

Tsuyoshi Fujiwara has modified theorem 8 2.1 3 in the following manner 

THEOREM 8 2 1.4 £471 

Let L be a first order language with equality Let F be a GA set of L. Then, JlF 
refers to the set of all formulas constructed by using the only connectives A and 
V and the quantifiers V and 3 Let 91 and ® be two structures of L. Then, the 
following two conditions are equivalent (i) Every sentence in LF that holds in 91 
also holds in 95 (li) There exist an elementary extension of 9J of 91 and an 

« X * 

elementary extension of 95 of 58 such that 95 is an F-morphic image of 91 

8 2 2 INTERPRETATION OF LYNDON'S HOMOMORPHISM THEOREM IN 
CONSTRUCTIVE ALGEBRAIC LOGIC 

In this subsection, we propose a preservation theorem of Lyndon type, based 
on Fujiwara's version of Lyndon's homomorphism theorem This preservation theorem 
IS applicable to various C(jj-systems 
Firstly, we require the following clarifications 

Let # be the class of closed predicate formulas that are either H 2 
provable Then, f contains the following 


r 

'i' 





^1 % 



146 

where, 

IS the list of constructive sentences without identity = 

IS the list of constructive sentences with identity s 
is the list of first order constructive sentences without identity in 
which quantification is done only on elements of sets 

'p” is the list of first order constructive sentences with identity in which 
quantification is done only on elements of sets. 

’p” and Po are lists of second order constructive sentences ac ording as 
2 ^ 

whether the identity is considered or not. 

For convenience let us consider an order constructive sentence without 
identity as CSj and that with identity as For example, CS 2 j refers to 

a sentence from the list P~ Let fn = PiU P~ Let us consider two sets 
of sentences from 4^^ srid denote them by and A 2 Let and 3?2 

and }SB 2 l as their carriers, be two systems defined by and d 2 
respectively Let F be the GE set of CS^'s and CSj^j^^s of d^fl d 2 Let M be a 

subset of iaft£lX!K 2 l Then M is an F-morphism of onto |Sft 2 l if M 

satisfies the following conditions ( 1 ) For any element a in there is 
an element b in 1 3^2 1 such that <a, b>SM (ii) For any element b in IK 2 I 

there is an element a in such that <a, b>6M. an) For any 4>i in F 

and any element bj^>, <a 2 , - ^ ^2' ■ ' 

implies SR 2 > 4n F-morphism is called an F-homomorphism 

if <a,b>,<a,c> € M implies b * c If we consider the constructive sentences 
without negation from d^Fl d 2 which form a GE set denoted by XF, then, M is 
an F-morphism of IK^I onto l^l implies M is a XF-morphism of onto 

l»J2f 

Using arguments analogous to those of Keisler [531, and invoking Harkov s 
result stated earlier C663, we may now conclude that-’ 
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THEOREM 8 2 2.1 

Let us consider two signal processing systems SB^ and SJg belonging to the 
model Cgfj , and let and ^2 denote the two sets of closed predicate formulas 
corresponding to first order properties of the two systems respectively Further 
let XF denote the set of closed predicate formulas of A 2 that do not contain 
negation Then, every sentence in jtF that holds for also holds for ^2 

8 2 3 THE PROBLEMS FACED DURING THE HOMOMORPHIC STUDY CF Cg^ 

We faced the following problems while testing theorem 8.2 2 i by actually 
applying it to various Cg^-systems 

(i) Let P be a property of a system and be its defining constructive 
sentence (DCS). If the DCS 4>p happens to be negative, then by virtue of the 
theorem 8221, it is not preserved in any homomorphic image We note that 
implication is a defined concept which makes use of negation and disjunction Does 
it mean then all the implied statements given in the table 81.1 are not preserved 
under homomorphisms '> Moreover, given a closed predicate formula, is it possible 
to obtain a logically equivalent GE formula from IF 

( 11 ) The oonlrapositive form of Lyndon's theorem is difficult to be proved 
[463 The converse is interpreted as that a first order property is reflected back 
from a homomorphic image to the real system if and only if its defining 
constructive sentence is necessarily a negative sentence Does it mean then, all 
those properties of the real system which are preserved in a homomorphic image 
should be definable by a negative constructive sentence in the latter"^ If it is so, 
how can we represent, for example, associatii/ity property of a system which is 
preserved in a homomorphic image by a negative sentence ? 

(ill) Higher order properties of a constructive system cannot be tested for 
their validity in a homomorphic image by using theorem 8 221. For instance, the 
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notions of sets and numbers are treated as normal algorithms and any 

quantification done over them in a closed formula, will lead to a higher order 

constructive sentence from 'flu it is well known in classical algebraic logic 

1 

that certain logical tools such as ultra filters and ultra products could be used in 
obtaining first order equivalents of certain higher order sentences Is it possible 
to formulate and use similar constructive logical notions in obtaining first order 
equivalents of higher order closed formulas 

In the nev^ section, we shall see that we can as such get rid of these problems 
by actually resorting to techniques established in Hammer's extended topology in 
the study of both first order and higher order system properties 



SECTION 9 


A CONSTRUCTIVE REFORHULATION OF EXTENDED TOPOLOGICAL FILTERS 

At the end of section 8, it was mentioned that notions like ultra filters and 
ultra products could be used in describing a higher order system property as a 
first order logical sentence In the classical sense, ultra filters constitute a 
special class of topological filters oi^er infiniU spaces These concepts of 
general topology are not of appropriate use in the case of C<^ , because of the 
fact that they are primarily meant for infinite spaces, ^#>ereas the basic spaces 
of our concern in the study of the model C{^ are finite In view of this fact, it is 
more appropriate in our case to use concepts from Hammer's extended topology, 
because the theory of his extended topology is applicable both to infinite and 
finite spaces [493, [503 

In this section, we reformulate the theory of extended topological filters in 
constructive logic and show that a normal algorithm ouer an alphabet A is an 
ordered sepuence of constructii^e extended filter bases oixer the same alphabet A. 

9 1 THE NOTION OF A CONSTRUCTIVE SET 


Topological notions are based on the classical concept of a set, which is 
commonly understood as a finite or infinite collection of unicjuely and 
simultaneously existing mathematical objects But the concept of a set is not 
unique in constructive mathematics, fo--, it depends on the language fla ^ , 

chosen to interpret the concept and hence it varies from case to case. We now 
present the interpretation that is to be used here 

In loose terms, a constructive set consists only of constructive objects A 
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mathematical object of analysis is known as a constructive object when it is 
represented as a word from some alphabet The terms set and property are 
considered here to be synonymous A constructive object is said to be a member of 
a set if it possess the corresponding property 
DEFINITION 911 [201 

Let Xq denote a collection of some words from an alphabet Jt Let be some 
property satisfied by the elements of Xq. Then the property Pq is said to be 
potentially enumerable tj'i Xq if one could specify another property which holds 
for those and only those elements of Xq 

¥ 

Given an alphabet A, if a variable s ranges over the entire free monoid A 

then s IS known as a base variable On the other hand, restricted variables are 

defined as those variables whose admissible values (words) are from a finite 

collection of words from A Now let us consider a one-parameter formula ^a, whose 

parameter C Ref subsection 7 i ] is an individual base variable Hereafter we shall 

not symbolically indicate the language in which the formulas are written So, is 

simply written as ^ is called an algorithmically verifiable condition (recursive 

condition), if one can construct some normal algorithm which would verify the 

fulfillment of the condition imposed by Let ^ be a formula of the language 

of the type VxP(x) where 3B(x) is a normal formula and x is a restricted variable 

whose admissible values are from some finite collection, say, X of words from a 

specific alphabet A Then one can construct a normal algorithm .W' which 

transforms every word chosen by x from X into 0 if 36Cx) holds or into 01 if P(x) 

does not bold Then X is said to be decided by the algorithm if In other words, 

given an alphabet A and a property one can construct a normal algorithm 

over A which would decide the set X of those constructive objects from A 

satisfying the property 3P Let us denote for convenience, this normal algorithm 
£ 

by Jf Borrowing the terminology from Bishop [71, we shall call this normal 
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£ 

algorithm JT as the preset deciding process 

A 

The following example illustrates how one could actually construct the preset 
deciding process over a specific alphabet for a given set property 
EXAMPLE 91.1 


Alphabet jip = (01) 

Preset to be decided N = { 0, 01, Oil, 0111, Ollll, . ... 3 


Preset property P Vx&COixl-dOrlx) 

y IS a property by which for ar.'. word x from v^o 
the symbol 0 is a left factor an .< the string 10 is 
not a factor 


Preset deciding process 


€ 

JC 

K 


01 


0 


0 


CNote This scheme transforms a word from Aq into a null string A if it 
satisfies yi 


A preset might contain more than one identical constructive objects which 

satisfy the stipulated property whereas such a repetition is not allowed in the 

notion of a set In order to overcome this difficulty, one can construct a normal 

algorithm Jf"~ which would regulate a preset X to contain only unique and 
X 

nonrepetitive constructive objects, by operating on every pair of elements of X, 

say, y and z represented as y*z in the following manner 

a) if y=z, then Jf~ <y*z)=y and 
X 

ui) if y ;^z, then iS not sa-definite t Ref subsection 7 2 3 for y*z and 

X 

the pair <y, z> remains unaltered 
DEFINITION 912 

A normal algorithm Jf" is defined as a regulator of uniaueness in itself of a 

X ^ 

preset deciding process Jf if for every y and z from X the following holds 

X 

Vyz &o(y = zWTLylKzJ = yoCyst z)-' 'Jf Ly*zJ 
X X . .. 
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Based on certain ideas given in £211, we provide the following technique using 


which one can construct a normal algorithm of the type Jf 

Let ^ be an alphabet, f and U be the individual generic variables, P and 0 
denote two words from A, a and )3 be the auxiliary symbols and * be the delimiter 
symbol Let us denote the graphical inverse of a word P as P*^ Then one can 
construct an inverting normal algorithm Jf” whose scheme would be of the following 
type 

JC~ 

aid ^ dai ( i, d € A ) 


aa 


0d 

<3 


JS 

e 

jUjS 


> a 

Now let us consider P*Q the ^-system of words from A One can construct 
cLevenng normal algorithms Jf and iT which would transform P^Q in the 
following manner (i) Jf^^(P^Q)s=Q and <ii) Jf^^(P3i^Q)=P The schemes of both Jf 
and JC are given below 

d^ ^ d € A) 

* »• 


K 


I* 


*d 


( jU € ) 


Using the composition theorem, [Ref Theorem 2 3 3 il one can construct a 
normal algorithm such that for any *-system P*Q of words from A, the 
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following hold <i) Jr*^~(P*Q)~if~(>r*^(P*Q) and (u) Jf*^P*Q)=Q''‘ Using union 
theorem, [Ref Theorem 23 323 one can construct a normal algorithm Jf'' such that 
the following hold for any P*Q 

(i) >r''(P*Q)~JT^*(P*Q)*#*1~(P*Q) and (ii) Jf^(P*Q)=:P*Q'^ 

Now one can construct a normal algorithm which would transform a string 

PlcQ ^ into an empty string only when P and Q are graphically equivalent Its 
scheme is given below 

tl^U, 1 * (u e J.) 

* r- 

Using the composition theorem, one can construct the desired normal algorithm 

such that the following hold for any P3fQ 

U) Jr=(P*Q)afJr^=W^(P*Q)) and 

(ii) .N'~(P*Q)=A if P IS graphically equivalent to Q 

Using the branching theorem, one can construct the normal algorithm Jf” such 
that the following holds for any P*Q 


Jf (P*Q)=>f‘'*<P*Q)=P If Jf“(P*0)=A 
X 


Now, let us consider the following alphabets 


(l) 

= ( 0 1 } 

(a) 

= ( 0 i - 3 

(Ill) 

,^2 = { 0 1 - / } 

(iv) 

vig = C 0 1 - / 0 } 

(v) 

11 

(VI) 

®2 = f D 3 

(Vll) 

D4 = C 3 C } 

(via) 


(ix) 



Given a specific property T stipulated by means of a formula £(x), one can 

construct the desired set X consisting of objects from a suitable alphabet -A, with 

the help of the normal algorithms and JT in the following manner • 

X X 

Firstly, one would make a suitable correspondence between the objects of 
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interest from A and verboids of the form DII^D , from with the help of the 

transcription theorem [ Ref Subsection 6 213 By and we mean the 

transcriptions of the respective normal algorithms ^ and Jf" 

X X 

Now, the notion of constructive set is defined in the following manner 
[NOTE This definition is a variant of Shanin's notion of a constructive set [3231 


DEFINITION 913 

By a constructive set we mean the canonically represented verboid of the 
form from the alphabet v4,j^5 » C 0 I 3 , ( 0 } where, decides the 

preset by identifying the verboidal transcriptions of those constructive objects 
which satisfy the property P stipulated by a one-parameter formula ®(x) and 
IS the corresponding regulator of uniqueness in itself of 



. ==v 


Without loss of generality, we can interpret a set process as 

SO as to generalize the notion of a constructive set as the one which is 

€ 5 = 

decided by a pair of constructive systems Sft and SR . The successful termination 

Jv A 

of the set process yields the desired set X which is the string of the 

form CXt,3 where Xt, is the , -dilution of all the unique objects decided by the 
process £ Ref Definition 3 17 3 


DEFINITION 9 14 

E 

A set X IS algorithmically enumerable if one can construct an algorithm 3^ 
over vtU£0 1} where A is an arbitrary alphabet such that for any natural number 
( a word ) n from Aq and any word P from A , the following hold • 

(i) if '3^(n) then Jf Cn) EX and 

XX E E. 

(ii) if PEX then one can find a natural number i for winch 'Jf (i) and J^(i) = P . 

Given any arbitrary alphabet, the set of all words of it is enumerable. The 
following theorem, which we quote without proof, compares the two concepts of 
algorithmically decidable sets and algorithmically enumerable sets 
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THEOREM 9 11 t203 

Every decidable set is enumerable, but the converse need not be true The 
intersection of a finite number of enumerable (decidable) sets is also enumerable 
(decidable) The union of a sequence of enumerable sets is enumerable whereas 
that of decidable sets can fail to be a decidable set 

Based on the definitions 9 1.1 and 9.1 4, the definition 9.13 is restated in-4h«" 
as follows 


DEFINITION 915 

By a constructive set, we mean a word of the form |9^jo|9rj from the 
alphabet such that decides (enumerates) the verboidal transcriptions of 
those constructive objects which satisfy the potentially enumerable prc^rty y 
stipulated by a formula 3e(x) and is the corresponding regulator of uniqueness 
in itself of 


DEFINITION 9 16 

Let 3P be a potentially enumerable property (PEP) of a set X constructed by 
Then X is said to be finite if the set process terminates. 

On the other hand X is said to be nonfimte if the set process is cloved to be 
nonterminating X is said to be Quasifinite, if one fails to prove that the set 
process does not terminate 
DEFINITION 9 17 

By thie complement of a set X of words from an alphabet A with respect to the 
entire set of all words from A, we mean the set X of words from A defined by the 
condition P€X s -(PEX) such that P does not satisfy the corresponding PEP of 


the set X 
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DEFINITION 9 18 

Given two PEP's and 5^2 stipulated by formulas $(x) and S(y) respectively, 
the constructive sets X and Y are equivalent if and only if all the elements 
decided by satisfy the PEP ^2 elements decided by 

satisfy the PEP 

As outlined by Shanin in C323, various operations on constructive sets and 
various propositions about them, are the corresponding operations and 
propositions about formulas 

So, the operations of union and intersection for constructive sets are defined 
in the following manner 
DEFINITION 3 19 

Given two PEP's and 5^2 stipulated by aB(x> and 33<y) respectively, the set ) 
IS enumerated by in the strength of and the set Y by 

in the strength of 5*2 such that their union (intersection) could be enumerate 
by ^ respectively ) in the strength of th 

potentially enumerable property 5*3 stipulated by B(z) satisfying the followir 
conditions 

( I ) 3 Vz®(z)VyCx)y(y) (for union operation) 

( II ) 3 Vz®(z)&y(x)S(y) (for intersection operation) 

DEFINITION 9 i 10 

Let and y 2 be two PEP's stipulated by »(x) and y(y) respectively Thf 
decides (enumerates) the set X in the strength of y^^ and the set Y 
decided by the process in the strength of y 2 . By virtue of definiti 

911, if y 2 IS an enumerable property of words of the basic alphabet sA. and if 
holds for those and only for those words of X which possess the property yj^, th 
decides a particular subset of the set X In such a case, we shall s 
that the property y2 is mbeddable in y^ Given a PEP y , for every one of 
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imbeddable property there corresponds a set which is a subset of the set 


correspnding to ? 

As already mentioned, for a given PEP T defined by a formula 3B(x>, the 

corresponding set X decided by the process is a word of the form CXt,3 

u 

from the alphabet { O I ) , C 0 } One can construct a normal algortihm -H" 

X 

which would find out a constructive natural number n corresponding to every word 
of the form CXt,3 indicating the number of , -terms in the word, which is in other 
words known as the cardinal nu. ber of the set X 
DEFINITON 9 1 11 


Two constructive sets X and Y corresponding to the PEP's and ^2 defined 
by 3B(x) and ®(y) are disjoint if one could specify an enumerable property 73 by a 
formula ®<z) so that the following condition holds 


bV23&(2)-(&SB{x)3B(y)) 


This means, for any two disjoint constructive sets X and Y the following conditions 


hold 


(1) 



(11) 




} 


(11) 




} 


The algorithm Jf'*' of the type shown below is used to add constructive natural 


numbers 
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Substitution formulas 


Formula number 
( 0 ) 

(i) 


In a similar manner, one can construct a normal algorithm Jf* like the one shown 
below which would subtract a constructive natural number from another 
Jf" Substitution formulas Formula number 


l.t ► , (0) 

l,0 » I, (1) 


0,0 > 0 , ( 2 ) 

0,1 >,-0l (3) 


(4) 


With the help of the normal algorithms JC^, K"*" and JC one can construct the 
following equalities which connect the cardinalities of any two arbitrary sets X 
and Y 



( 11 ) 



Jf 


tJfUJfJ 


€ = ’ 
£35 3DC35 } 

XHY XHY 


Now, the notion of a power set is interpreted in the following manner- With 
reference to definition 9 1 10 , given a set property which is potentially 
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enumerable^ one can specify an enumerable property 3^2 which is imbeddable in 
so that the corresponding set of 3^2 becomes the subset of the set corresponding 
to In what follows, we suggest a method by which one can construct the power 
set using the idea of property imbeddability 

An enumerable property 3*2 is said to be imbeddsble in a given PEP if and 
only if 3*2 holds for those and only those elements of the set described by the 
property 3*^^ Let us assume that 3*^ and 5*2 which are defined by one-parameter 
formulas, say, $^(x) and S 2 <x) respectively, are restricti. i-free In other words, 
these enumerable properties are not stipulated with any restriction in deciding, 
for example, the number of elements which satisfy them In such a case, the 
imbedding of 3*2 m 3*^ is called free imbedding On the other hand, if *2^^^ 
formulated along with its validity subjected to one or more constraints and 5*2 is 
imbeddable in 3*^^ , then the imbedding is called restricted imbedding For example, 
if the restriction is about the cardinality of the set to be decided then the 


corresponding restricted imbedding is called cardinality restricted imbedding Now 

the poufer set of a gii/en constructu^e set is obtained as follows. 

Let Xq be the constructive set decided by strength of the 

PEP 3*0 by the formula SB [ Note The restricted variable is not shown here in the 

logical formula 3 Now one can specify enumerable properties of the types 5 *^q , 

' ^12 ' ' ^In where n is the cardinality of the base set Xg Thus one 

can specify ^^Cg number of properties of the type 3*^g , number of independent 

properties of the type 5*^^^ , *^C 2 number of independent properties of the type 5*|^2 

and so on, up to number of properties of the type 3*^^^ In general, one can 

k f h 

specify potentially infinite enumerable properties ? , where i is the i power of 

ij 

the base set, j is the cardinality index that ranges from 0 to the cardinal number 


(ni_i) of the (i-l)^^ power set and k is the index that ranges from 1 to 
j 20 for every 3*^^^ and for every lil t Table 3113 


<■^ 1 - 1 ^ 
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Table 911 Potentially enumerable properties corresponding to the 
power set of a constructive set 


SI No 

Subset properties 

iNumber of 
properties 

Remarks | 

1 

1 

y 

10 

1 

Any property which 
holds for none of the 
elements of the base 
set Xq 

2 

I 2 k n 

y / y , .y / ^y 

II 11 11 11 

n 

k 

y implies any abstract yn 

11 0 

imbeddable properly that holds 
only for the k^^ element of the 
base set Xq 

3 

12k 

y , y , ,y , 

12 12 12 

np 

^2 

k 

y^^ implies any abstract yg 

imbeddable property that holds 
only for the k^*' pair of elements 
of Xq 

4 

12k 

y , y , ,y , 

13 13 13 

Dp 

^3 

k 

y implies any abstract 

13 

yg- imbeddable property that holds 

for the k**’ triple of the set Xg. 


1 

i 

i 

2" 

1 

y 

In 

- 

1 

Any yg-imbeddable property that 
holds to all v elements of the 
base set Xg 
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DEFINITION 9 1 i2 

Let be the given PEP in the strength of which decides the 

constructive set Xq . Let denote any abstract cardinality restricted, ^q- 
imbeddable enumerable property Let I = n Then the power set X of the base 
set Xq is of the form which is decided by the process using 

the property which is a system of 2^ ^Q-imbeddable properties 

ij 

Based on the above details, we now reformulate the theory of extended 
topological filters in the constructive logic 

9 2 CONSTRUCTIVE EXTENDED TOPOLOGICAL FILTERS 

In 1937. Cartan formulated the concepts of filters and ultra filters which 
were later developed by Bourbaki, Schmidt and Grimeisen. The development of the 
theory associated with these concepts took place as a part of the study of 
general topology But these mathematical tools of general topology have been found 
wanting in the study of various problems of topological nature in areas like 
control systems, signal processing, logic and computing, and system theory This 
IS due to the fact that the general topology deals only with infinite spaces [443 

In i96i. Hammer brought various extensions in general topology such that his 
theory could be applied to finite sets also A filter in general, as defined by 
Hammer, is an ordered dichotomy over a set <accepted elements, rejected elements > 
[443 Let us take for instance a normal algorithm Jf over an alphabet A Jf is a 
filler in the sense that it divides the free monoid into two disjoint sets $ 
and is the set of all strings in A* to which Jf is sa-definite 

[Ref subsection 7.23 and $ is its complement with respect to So the normal 

algorithmic filter is represented by the ordered dichotomy < $ , $ > 
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Following this notion of a general filter, Thampuran developed the notion of 
an extended Filter which is a generalization of the concept of a filter due to 
Cartan [751 An extended filter over a finite set is a set which consists only of 
elements from the power set of the given set other than the null set such that 
every element present in the filter set ensures the presence of every one of its 
super sets which are elements of the power set 


9 21 DEFINITION OF A CONSTRUCTIVE EXTENDED FILTER 

On the same lines of Thampuran, we think of a constructive extended filter 
over a base set Xq as a property described by a formula 36(f) where Pp is the 
system of the union of certain cardinality restricted yQ-imbeddable subset 
properties such that every such property present in the system 3Pp ensures the 
presence of all those cardinality restricted yQ-imbeddable properties which would 
form a linear chain with it as the basis, by the partial ordering of imbeddability 
A formal definition of constructii/e extended filter is given below 


DEFINITION 9 2 11 

By a constructii^e proper extended filter oyer s base set Xq , we mean a set F 
which IS decided by the process in the strength of the filter property 

^p depicted by the formula S(f) such that the following conditions hold for F 

(i) If a set decided by the process /jB k}^(% k} ® ■filt-sr element, then 
every element in the power set where j?*! 

and k ^ k' and for which the element /iB ^ subset due to the 

X^j ' 1^, 

restricted imbedding of the property ? in the property 3^^, ® ^ 

element 


(ii) y does not belong to the system of properties fp 
10 


The definition of constructive improper filter 


would be obtained if the 
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condition <ii) in the definition 9 2 1 , is replaced by the following one 
^0 system of properties S^p 

However, we are concerned here only with constructive proper extended 
filters and hereafter we shall call them simply as constructu^e extended filters 
DEFINITION 9 2 12 

A constructive extended filter (CEF) is called a constrcicti^'e cartan filter if 
it satisfies an additional condition that the intersection of any two filter 
elements is also a filter element 


9 2 11 SPECIFIC RESULTS CONCERNING CONSTRUCTIVE CARTAN FILTERS 


Let us consider a base set Xq over an alphabet A Let and 

Io/dT 1 be two constructive cartan filters defined over Xg in the strength of 
' Fa' ' Fz^ 

the filter properties Pp^ and Pp^ Now if Pp^ is Pp^-imbeddable, then 

} is said to be finer than |ilff in other words, Jo^af?" J 

IS said to be coarser than 

Let us now consider three cartan filters Fi, Fa and Fs over Xq described by 
the PEP'S Ppj^ , Pp 2 ^Fs •respectively Let us also assume that Pp^ is Pp^- 

imbeddable and Pp^-imbeddable and Ppj, is Ppjj-imbeddable Then, Fa is said to be 
the interpolant f liter of Fi and Fa 

Given two cartan filters Fi and Fj , the latter for instance is said to be a just 
finer filter of the former only when the following two conditions are satisfied 
(i) Pc- must be a pp -imbeddable property 
ai) There is no interpolant filter between Fi and F,. 

Let us consider n cartan filters over Xq where iii^n be the 

j^th n CEF's are said to form a linear filter chain if and only if for 

every CEF, the CEF is a just finer filter 


every 
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restricted ?Q-iinbeddable properties such that the power set is obtained as 

(£R^ }□{# } = £O,{0l03.f0ll0),C0lll03,{:0l0,0ll0XCOI0,0Ili0},C0ll0,OIII0},C0l0.0ll0,0[ll0}3 

Now, three ultra filters could be obtained by virtue of three independent J’q- 

imbeddable ultra filter properties 

(1) |ol»f ) = £C0 103,C0 D,0 1 103,C0 10,0 1 1 103,C0 0,010,0111033 

' Fi'' ^ fJ 


(11) (of )o(9? ) = C<:0l03,c00,0(03,{0l0,0li03,£00,010,0ll033 

(Hi) Jo/aT } = ££0ll03,c00,0ll03,c0l0,0il03,{00,0l0, 011033 

^ F3^ ^ Fs-^ 

The family of all constructive cartan filters over Xq is given in table 
92111 and the corresponding lattice structure is shown in figure 9 2 1.1 1 

Table 92111 Constructive cartan filters over a set X = £00,010,01103 


SI No 

constructive cartan filters 

1 

{of )□(«“ \ = ££003,£00,0103,£00,0ll03,£00,0l0, 011033 
' Fr ' f/ 

2 

/JB„ )D|afr \ == ££0l03,£00,0l03,£0l0,0ll03,£00,0l0,0ll033 

F2^ 

3 

/£rf lo/af } - ££01103, £0D,0IID3,£0IO,01ID3,£0O,0IO,0IIO33 
' Fs ' F3^ 

4 

= ££00,0l03,£00, DIO, 011033 

5 

(aif WaT 1 = ££00,011103, £00,010, 0111033 
' F21^ ' Fzi' 

6 

1 . £ ^ 

= £(0110,01I103,£010,0II0, 011033 

7 

J = ££00,010,011033 
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FIGURE 9 2111 Lattice formed by the constructive cartan filters over 

Xq = £010,0110,011103 


92 1.2 GENERAL RESULTS CONCERNING CONSTRUCTIVE EXTENDED FILTERS 


Given a constructive set properly , its constructive 

e = ^ ^0 V 

power set hi } possesses a relational structure of a complete lattice in 

which the lower bound of two subsets is their intersection and the upper bound is 
their union A complete lattice is a partially ordered set in which every nonempty 
subset has a supremum and an infimum 


EXAMPLE 9 212 1 

Let us consider a set of constructive objects from an alphabet A which is 

decided by the process strength of the property IPg such 

€ = ^0 ^0 

that )-o(k } = £010,0 1 10,0 1110,0111103 Then the power set property consists 

of 16 properties of the type y 0iji4 and lik:^ C^ which are “g-imbeddable 

€ =s 

such that 16 constructive subsets of the type /iR kl£3/SJ itl t Ref • table 

^ij •’^1, 

92 12 1] form the power set X^. 
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Table 9 2 121 Subsets of a constructive set 


SI No 

Constructive subsets of J = C0I0,0 110,0 II 10,0 II 110} 

1 

^14 ^X4 

\ = COlO, 0110,01110,011110} 

2 

K ‘W«“x 

( = {010,0110,01110} 

3 

/ € \ 

D{«X 4 

^X& 

= {010,0110,011110} 

4 


□{«“ 4 

= {010,01110,1(1110} 

5 

^13 

!!{«= 4 

•^xs 

= {0110,01110,011110} 

6 

K 4' 

•^12 

3{!>f 4 

^X2 

= {010,0110} 

7 

■^12 

3{i>r 4 

^i2 

= {010,01110} 

8 

•^12 

4*“ 4 

•^12 

= {010,011110} 

9 

•^12 

4 

^12 

= {0110,01110} 

10 

-^i2 

’(“St 4 

^X2 

= {01110,011110} 

11 

<*x 

^X2 

'{“St 4 

■^12 

= {0110,011110} 

12 

-^11 

'{“Sc 4 

^XX 

= {010} 

13 

LJ 

'(“St 4 

•^11 

= {0110} 

14 

("I 4“ 
^11 

'{“St 4 

Ail 

= {OHIO} 

15 

Kj° 

'{“S<.4 

= {011110} 

16 

K 4° 

-^10 ' 

{’St„4 

= {} 
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THEOREM 9.2 1 2 1 

Given a constructive base set )■ the property , let us 

denote by $ , the family of all constructive extended filters over the base set 
Then $ possesses a relational structure of a complete distributive lattice which 
IS denoted by <f, C) where C is the relation 'coarser than' 

PROOF 


The condition for any lattice to be complete is that every one of its elements 
should have a supremum .ind an infimum This means the union and intersection of 
nonempty elements of the lattice should also be the lattice elements. In the same 
way we can assert that <#, C) is a complete lattice, by proving that the union and 
intersection of any nonempty family of CEF's are also CEF’s Let us consider n 
CEF's which are certain elements of the lattice under consideration Then in the 
strength of theorem 9 11 and definition 9 19, one can construct the following 
processes 



which would enumerate the intersection and union of the n CEF's The intersection 
of n CEF's is also a CEF due to the following reason Every element of the 
constructive set of the intersection of n CEF's is present in all the n CEF's This 
IS obvious due to the very definition of intersection. By virtue of the definition 
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of a proper extended filter, every such element which is present in all the n CEF's 
ensures the presence of all of its super sets which are elements of the power set, 
in all the n CEF's This in turn implies that all such super sets are present in the 
set of intersection of all the n CEF's also, thus making it a CEF A similar 
reasoning could be made in order to prove that the constructive set of union of 
all the n CEF's is also a CEF Thus one can see that the structure <§, C) is a 
complete lattice The distributivity of this lattice can be proved in the following 
manner Let us consider three CEF's Fi. F2 ar<' Fa decided by 

} respectively The distributivity is viewed in two ways 
(1) Fin (FzU Fa) K (Fin Fz) D (FiO Fa) and 


(11) FiU (Fan Fa) as (FiU Fz) O (FiU Fa) 
such that the following equalities hold 
E 

(I) (si |o/«~ 1 = 

'' Fin (FzU FsV V Fin (FzU Fa)^ 

^ (Fin F2) u (Fin Fa)^ 1 (Fin Fz) U (Fin Fa) 

(II) \=^ 

^ Fin (FzU Fa)/ \ Fin (FzU Fa)/ 



(Fin Fz) U (Fin Fa) 



(Fin Fz) U (Fin Fa) 


Now let us consider equality ii) Any element of the set in the left hand side 
of the equality should either be the element of both |ilfl_ and ^ 91 . )■ 

or both | and proves equality (1) Equality (ii) can be 

proved in similar terms using the principle of duality 

So, the structure ($, C) is a complete distributive lattice 



(1) 
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(ii) 


n H«‘ n H«n | 

FD ( U F>y ' fn < iJ F.v y 11 (Fn r.if \ i j fpr> p.y 

1=1 


FD ( U F.) 
1=1 


U (FH F.)^ 
1=1 


U (FH F.y 
1=1 


DEFINITION 9 2 12 1 


Given a base set Xq with the PEP J^q , one can specify an arbitrary system 
Per of yQ-imbeddable properties by which the process would decide a 

certain collection of subsets of Xq Now one can specify a filter property 
such that would decide a CEF which contains all the elements of the 

constructive set decided by the process and their corresponding super 

sets which are the subsets of Xq . Then the CEF ISLjoIsC) is called the CEF hull 
of the base and it is the smallest filter that the base could generate 

THEOREM 9 2 12^ 

Let I be a constructive subset of another where both 

are subsets of the base set Xg Then the corresponding CEF hulls are related by 
the expression 


{^Mi} s {<Wi} 


PROOF 

The proof is the direct consequence of the definitions 32 i., and 9 2 1.2 1 


DEFINITION 9 2 12 2 

A CEF or in general any family of constructive sets is said to have Pairmse 
Intersection Property (PIP) if and only if any two elements of the CEF or any two- 
member subfamily of the family of sets has a nonempty intersection. Similarly, a 
CEF or a family of constructive sets is said to have Finite Intersection Property 
(FIP) if and only if every finite number of elements of the CEF or every finite- 
member subfamily of the family of sets has a nonempty intersection. 

One can easily verify that if a CEF base has either PIP or FP, then 

the corresponding CEF hull gleo has the same preperta. 



DEFINITION 9 2 12 3 
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Let Xq be a base set and X be any one of its subsets Then the complement 


of X with respect to Xn is a set decided by iiR 


by virtue 


k' k' 

of the property P P holds for all the elements of Xn other than those which 
if if ^ 

k k 

form the set X by satifying the property P Now, one can specify a filter 
Ij Ij 

property P^ jch that the CEF j contains strictly either 

F F 

Isft loilR [ or Ik Id/** I in which case it is known as 

I X "f I X "/ I Xo-X */ I Xo-X •'/ 


in which case it is known as 


Umyerssl Filter 


DEFINITION 9 2 1 2.4 

Let Xq be a base set and X^^ its power set Let be a CEF base set 

which consists of a single element from X^ Then the corresponding CEF hull 
IS known as a Principal Filter If the single element of the filter base 
from happens to be a single element of Xq then the corresponding principal 
filter IS a universal filter which is also known as ultra filter of the cartan type 


The family of all CEF's over the base set Xq exhibits a complete distributive 
lattice (§, C) where the symbol C refers to the partial order relation 'coarser 
than' 

EXAMPLE 9 2 12 2 

Let the base set be (« jD/sT ) = £010,0110,01110) so that the power set 

' Xq' ^ Xq^ 

IS ) = {£3.£0I03, £0110), £01110), £010, 0II0).C0I0,0I1I0},{0II0,0III0),£0I0,0II0, OHIO)}. 

One can construct 18 CEF's over Xq C Ref table 9 212 2 3 and the lattice $ 
formed by these CEF's are shown in figure 9 212 2 
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Table 9 2 12 2 Constructive extended filters (CEF’s) over Xq = {0ID,0lf0,0IIID3 


SI 

No 

CEF's 

CEF bases 

1 

(gpf }o(9f } = {C0I03,C0(I0},C0III0}, 

V Fi> Fi’ {010,0110X010, 011103, • 

£0110,0(1103, 

£010.0110,0111033 

(af Jo^afJ = ££0l03,£0!l03,£0lll03) 


(af j-o/af } = ££0I03,£0II03,£0D, 01103, 

V F2^ F2^ £0I0,0(II03,£0((0,0(((03, 

£010,0110,0111033 

(af^}o(af^} = C{oio},{oiio33 

3 

Jo/af } = ££0l03,£0lll03,£0l0,0ll03, 

^ Fs^ Fs^ £0l0,0(ll03,£0(l0,0fl(0), 

£010,0110,0111033 

= ££0103,£0ill033 

1 

(an^ lo/ffT } = ££01103, £0lll03,£0l0,0il03, 

1 F4f V F43 ££010,0(1103,£01I0,0(II03, 

£010,0110,0111035 

{af jD{arj = {{01I0),C0I1I033 


isf lo/af } = ££0103,£010,01103,£010,0lll03, 

1 Fsf ' Fs^ £0110,01103, £010,0110,0111033 

|af^^D|ar^| = ££0103,£0II0,0!II03} 

& 

(fR }o/air } = ££0ll03,£010.01103,£010, 011103, 

1 F6> ^ Fe^ £0110, 011103,£010, 0110, 0111033 

= ££0!D3,£010,0lil053 

1 

|aif } = ££0lll03.£010.0ll03.£010,011i03, 

^ F?^ ^ F7> £0110,011103, £010,0110,0111033 

{3|^}D{af J = ££0(li03,£010,0ll03} 


(af jo/af } = ££0103, £OIO,OIIQ3,fOIO, 011103, 

^ Fs^ ^ Fs' £010,0110.0111033 

(CwCs) = 

9 

(af lo(af 1 = ££01103, £010,01103, £0110,011103, 

F 9 ’ Fs' £010,0110,0111033 


10 

ffff jo/af } = ££011I03,£0I0,0II103, 

^ Fio^ ^ Fio' £0 1 10,0 11103,£0 10,0 10,0111033 


11 

jalaf \ = ££oio.oiio3.£Oio,oiiio5, 

^ Fil' ' Fir £0110, 011103, £010, 0110,0111033 

£010, 0III03,£0II0, 0111033 

12 

{af jolaT } = ££010,01103,£010,01I103, 
t F12^ ' Fi2^ £010,0110,0111033 

{\i2M”ci2} = 

£010,011103) 

13 

/af iDlaf ] = ££010,01103,£0110,01I103, 
t Fi3' ' FiS/ £010,0110,0111033 

(af Waf \ = ££010,01103, 

1 <713; \ tris/ 

£0110,0111033 



contd 














17A 


14 

(iR }o{9fl } = CCOlO, OHIO), {0110, 011103, 

Fi4' Fi4/ COIO,OIIO,DIII033 


(si 1 = {{010011103, 

CF 14/ 

{0110.0111033 

15 

(srf blsB" \ = {{010, 01103, {010, 010,0111033 

Fis^ '' Fis' 

(sft^ Wafj \ = {{010,011033 

1 CTLS! \ (Jis) 

16 

(aff lo/afT \ = {{oio,oiii03,{oio,oiio, 0111033 
'' Fis' ^ FiS'^ 


''s? \ = {{010,0111033 

(716/ 

17 

(af jo/af \ = {{oiio,oiiio3,{oio,oiio,oiii033 

Fi7^ ' F17' 


^af 1 = {{0110,0111033 

(TLIJ 

18 

jaf lo/afT ] = {{oio,oiiox)iiiP33 
^ Fi 8^ ' Fis-' 


af \ = {{0110,0111033 

1 (718/ 
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9 3 DESCRIPTION OP NORMAL ALGORITHMS IN TERMS OF 
CONSTRUCTIVE EXTENDED FILTER BASES 


In the beginning of subsection 9 2., it was argued that a normal algorithm Jf 

over an alphabet is a filter in the sense that it divides the free monoid 

into two disjoint sets $ and $ where $ is the set of all strings in A to 

— >Jf 

which Jf IS sa-def inite C Ref subsection 7 2 3 and $ ‘ is its complement with 
respect to vt* So the normal algorithmic filter Jf is represented by the ordered 
dichotomy < 

Here we show how a normal algorithm could be visualized in terms of 
constructive extended filter bases 

With reference to definition 2 2 1., a normal algorithm Jf over an alphabet 

consists of an ordered list of substitution formulas of the type P i Q where 

% % % % 

each substitution formula could be viewed as a map of the type .X P>4. ► <A, Q.X 

The left hand side of the map is a set containing the element P which is a subset 
of the free monoid and elements for which P is a factor Similarly the right 
hand side of the map is a set containing the element Q which is a subset of the 
free monoid vt* and elements for which Q is a factc^ We shall denote both the 
sets vA^P,.A* and by P and Q respectively Just as the partial order 

relation 'subset of' indicates the occurrence of a set in another, the partial order 


relation 'factor of' C Ref SI No 3 of Table 8111 indicates the occurrence of a 
string of symbols in another string So, P and Q could be interpreted as CEF's with 

their respective bases P and Q Thus a substitution formula P i Q of the normal 

algorithm Jf is viewed as an ordered pair < P, Q > of constructive extended filter 
bases This amounts to saying that the normal algorithm Jf is a totally ordered list 


of ordered pairs of constructive extended filter bases 

Normal algorithms are thus seen to have a direct relevance in all potential 
applications of Hammer's topological techniques in signal processing 



SECTION 10 


QUANTIFIABLE MEASURES OF CONSTRUCTIVE EXTENDED FILTERS 
IN TERMS OF NORMAL ALGORITHMIC OPERATORS 

Erlandson introduces three different measures of the filtering capabilities of 
extended filters (i) the ambiguity of a filter, (ii) the discrimination of a filter and 
(ill) the resolution of a liter [433 In addition, he introduces a metric over a 
space of filters, a measure of how close or far apart two different filters are 

Significantly, Erlandson's measures can be given a constructive interpretation 
as well In fact, we could interpret these measures as normal algorithmic operators 
mapping a metric lattice of extended filters over a constructive set, into the 
metric space of constructive real numbers But to describe our interpretation, we 
need to go into the details of constructive mathematical analysis, starting from 
the formulation of various constructive numbers, functions and function spaces 
This would cause a diversion from the main flow of the thesis. So, we describe in 
what follows, the quantifiable measures for CEF's on similar lines of Erlandson, 
without loosing the constructive aspects in them 

10 1 QUANTIFIABLE MEASURES FOR CONSTRUCTIVE EXTENDED FILTERS 
10 11 AMBIGUITY OF A CEF PROCESS 

Let us take the lattice ($, C) formed by a family of CEF's over an alphabet J.. 
Ideally, a filter should not accept both an element and its complement, whereas, 
such a condition is not stipulated in the definition of a CEF So, any CEF that 
accepts both an element and its complement is called an ambiguous filter 

We denote the ambiguity measure of a constructive extended filter F^ of k 
elements by and define it as 
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If X X£ Fj and both X and its complement X are in Fj^}| 


Universal filters are non ambiguous The coarsest CEF contained in # is the 
least ambiguous filter and the finest CEF in # is the most ambiguous filter. 

10 12 DISCRIMINATION OF A CEF PROCESS 

Discrimination of a CEF, F^ of k elements, is a measure of the number of 
elements accepted by it We denote this measure as and define it as 



The finest CEF is the most discriminating filter and the coarsest CEF is the 
least discriminating filter 
10.13 RESOLUTION OF A CEF PROCESS 

Resolution is a measure of the smallest size of of the elements accepted by a 
CEF We define this measure in the following manner 

Let Fj be a CEF and be its base Now, we denote the resolution measure of a 

CEF, F^ of k elements as and define it as * l<j\l 

The finest CEF has a resolution 1/k, where, k is the cardinal number of the 

CEF and the coarsest CEF has a resolution i 
iO i 4 DISTANCE MEASURE BETWEEN TWO CEF'S 

Consider two arbitrary CEF's, F^ and Fj in a lattice of CEF's. Now the distance 
between these two CEF's is given by 

IF^UFjl - IF^nFjl 
*5 * IFiUFjl 

EXAMPLE iO i i 

Let us recall the example 9 2 1 2 2 and characterize all the 18 CEF's based on 
their Erlandson's measures 

Let be an alphabet and Xq = £010,0110,01110) be a base set constructed over 
J. One can construct 18 extended filters over the set Xq The complete 



178 


distributive lattice formed by these 18 CEF's C Figure 9212.2 1 is once again 
shown here in figure 10.1 1 along with the distance measures indicated at the 
aopropriatf places £ NOTE We interpret the word 01/0 III III! as the rational number 
1/7 A similar interpretation has to be made for any other word of this type 1 



FIGURE 10 1 1 Same as figure 9 212 2 
The remaining measures pertaining to the above example are given in table 

1011 
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Table 10 1 1 Quantifiable measures of CEF's over Xq = <010,0110,011103 


SI No 




1 

0111/01111 

Olllllll/Ollll 

01/0111 

2 

011/01111 

0111111/01111 

01/011 

3 

011/01111 

Ollllll/Olltl 

01/011 

4 

011/01111 

Otlllll/01111 

01/011 

5 

01/01111 

Olllll/Ollli 

01/011 

6 

01/01111 

Oltlli/Ollli 

01/011 

7 

OI/OIllI 

011111/01111 

01/011 





8 

O/OlHl 

Ollll/Ollll 

01/01 

9 

0/01111 

01111/01111 

01/01 

10 

0/01111 

Ollll/Ollll 

01/01 

11 

0/01111 

Ollll/Ollll 

I OI/OIII 





12 

0/01111 

Oill/Ollll 

! 

01/011 

13 

O/Olltl 

0111/01111 

01/011 

14 

0/01111 

Olll/Ollll 

01/011 

i — 

15 

O/Ollll 

011/01111 

01/01 

contd. . 
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16 

O/Ollli 

OII/OIIII 

01/01 

17 

O/Ollll 

Oil/OIIII 

01/01 

18 

O/OIIII 

oi/omi 

01/0! 


10.2 COMBINATORIAL THEOREMS INVOLVING QUANTIFIABLE MEASURES OF CEPs 

Certain observations were made while computing Erlandson's measures Tor 
various CEF's over base sets whose cardinal numbers are less than or equal to 
three 

Those observations are stated here in the -form of the following theorems 
THEOREM 10 2 i 

Let Xq be the base set whose cardinal number is k. Then the following 
statements are valid ■ 

(i) The finest filter is the most ambiguous filter over Xq whose k £ 3 or k >3 
(li) The coarsest filter is the least ambiguous filter over Xq whose k ^ 3 or k>3 
(ill) All the universal filters are nonambiguous filters over Xq whose k £ 3 or k>3 

(iv) All the CEF's which are coarser than universal filters over Xq whose ki 3 

are nonambiguous filters 

(v) Ambiguity creeps in certain CEF's which are coarser than universal filters 

over Xq whose k>3 

PROOF 

(i) It IS obvious that the cardinal number of the power set of the base set 
Xg IS 2*^ The finest filter contains all the elements of Xj^ other than the null set 
This means that the finest filter allows maximum number of subsets along with 
their complements too, thus possessing the highest measure of ambiguity 
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(ii) The coarsest filter contains the base set Xq as its only element This 
shows that it is the least ambiguous (nonambiguous) filter 

(ill) A universal filter by virtue of its definition satisfies pairwise 
intersection property This rules out the presence of any pair of elements of a 
universal filter which are complement to each other So the universal filters are 
nonambiguous 

(iv) Refer to table 10 2 1 All the CEP's F ^2 to si's nonambiguous 

(v) Let us consider Xq = -tllO, DID, OHIO, 011110} whose k = 4 One can construct 
CEP's which are ambiguous and coarser than the universal filters similar to the 
one given below 

(af }o(»r J = {COIO,OIIO},fOIIIO,OIIII03,COIO,OIIO, OHIO}, C0l0,0il0C)illl03, £010, 01110,011110}, 

Fi 

COIIO,01IIO,OIIIIO},COIOX)IIO,OIHO,OIIH03} 

The number of ambiguous filters which are coarser than the universal filters 
increases when base sets of higher cardinalities are considered 
THEOREM 10 2.2 

Let Xq be the base set whose cardinal number is k Then CEP's whose cardinal 

k-i 

numbers are greater than 2 do not possess pairwise intersection property (PIP) 
PROOP 

k-i 

All CEP's whose cardinal numbers are greater than 2 are ambiguous and 
ambiguous filters do not possess PIP 
COROLLARY- 

All those CEP's which possess PIP would be of cardinalities less than or equal 
to 2**^"^ This IS the direct consequence of theorem 10 2.2. 


THEOREM 10 2 3 


The discrimination measure of a family of CEP's over a base set Xq of 
cardinality k, ranges from to in steps of 
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PROOF 

F,l 

As defined earlier, the discrimination 0 ^ of a CEF, F^ is given by 0 ^ = — ^ 
Now the complete distributive lattice formed by the family of CEF's over a given 
base set of cardinality k, consists of linear chains of CEF's Each linear chain 
contains CEF's which are linked by the relation "just finer than" The distance 


measure between any two CEF's, of which one is just finer than the other is -j^ 
This IS true for all linear chains contained in the lattice Hence the theorem is 
proved 


THEOREM 10 2 4 

For base sets with k^3, every universal filter which satisfies both FIP and 
PIP, yields a universal filter of resolution 1/k and which satisfies only PIP, when 
the base element of the former is replaced by its complement with respect to Xq 


PROOF 

The universal filters over a base set Xq , which satisfy both FIP and PIP are 

ultra filters of cartan type whose single element bases consist of elements from 

Xq Let us consider one such filter Fj^ whose base consists of any one of the k 

k-i 

elements of Xq By virtue of the definition 9 2 1 i i , the remaining (2 -1) 
elements of F^ must contain this base element If this base element is replaced by 
Its complement set which is a subset of Xq consisting of (k-i) elements of Xq , then 
the finite intersection property does not hold for the resulting filter On the 
other hand, the complement set has a nonempty intersection with each of the 
(2*^'^-l) elements of F^ So, the resulting filter is a universal filler which 
satisfies only PIP Let us denote this resulting filter by F^^ The base of F^^ will 
then consist of k elements, in which (k-i) elements would be the super sets of 
cardinality 2 of the base element of F, and the remaining one element would be the 
complement set of the base element of F^ For a base set Xp with k=i there is only 
one universal filter and the question of complement set of its base does not arise 



183 


at all For a base set Xq with k=2 there are two universal filters whose bases are 

complements to each other So the ouestion of getting a universal filter of the 

type does not arise at all For a base set Xq with k=3 there are three 

universal filters and only one universal filter of the type F, would result when 

j-c 

any of the bases of the three F^'s is complemented C Ref table 92 12.2 3 For a 

base set Xq with k>3 each of the k universal filters of the cartan type ultra 

filters would yield a unique and independent universal filter of the type F, with 

■^c 

the resolution 1/k when its base element li complemented 

The following theorem due to Erlandson, characterizes a certain kind of 
universal filters in terms of 'resolution' 

THEOREM iO 2 5 C393 

Given a base set Xq with k^S and k being an odd number, one can construct a 
— k 

universal filter F^ with 

[ NOTE Ck/23 denotes the next integer greater than the result of dividing k by 2. 
Similarly (k/2) denotes the next integer less than the result of dividing k by 2 3 



CONCLUSIONS AND PERSPECTIVES 


The results presented in thus thesis are the outcome of an effort to build a 
constructive logical theory for nonnumerical signal processing 

In our opinionj the constructive approach to nonnumerical signal processing 
adopted in this thesis, has turned out to be successful in the sense that several 
central notions of traditional numerical signal processing could also be 
interpreted within the framework of constructive mat! 'matical logic and a few new 
notions have emerged together with results concerning them 

The work presented here nevertheless marks only a beginning and, besides 
some of the loose ends indicated at several places in the text, there are a number 
of interesting problems and ideas that can be suggested for future study. In 
summary, these are as follows 

1 The idea of using constructive extended filters in the topological 
processing of signals and images would seem to be of considerable promise 

2 The concept of M-grammar, which has been developed in section-5, could be 
studied in the light of Selective Substitution Grammar, which was introduced by 
Rozenberg E293, C30], with an intention to provide a general formal definition of a 
rewriting system This may open up possibilities of using M-grammar in 
multidimensional image pattern generation similar to the use of Lindenmayer 
rewriting systems 

3 The possibility may be explored for the use of the notion of a constructive 
set, which has been developed in sectiori-S, in morphological image processing. It is 
to be noted that morphological operations like erosion and dilation are set 
theoretic operations that would seem to lend themselves well to a constructive 


adaptation 



185 

4 Computable analysis of Boolean functions by means of normal algorithms is 
another interesting area for potential research C NOTE. A Boolean function of n 
variables is a function of an n-dimensional Boolean vector An n-dimensional 
Boolean vector is a word of length n from the alphabet v4o = C 0 * 3 1 The 
material provided in the first part of this thesis would be of help in constructing 
normal algorithms that compute Boolean functions 

5 Finally, an important step that one could take is to construct efficient 
norma algorithms for various requirements so that a suitable environmen could 
be developed for carrying out further research and exploring the possibility of 
hybridising numeric and nonnumeric signal processing 

As a closing remark, it may be added that the results pw'esented in this thesis 
are likely to find their use in areas such as those of Image and signal processing. 
Control systems. Logic and computing. Formal languages and automata. Symbolic 
artificial intelligence and Communication networks 
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APPENDIX - 1 [A 13 
CYCLIC SHIFTING SUBROUTINE 
LISTING OF A SUBROUTINE 

DESIGNED TO IMPLEMENT DESIRED NUMBER OF CYCLIC SHIFTS 
IN ANY ARBITRARILY LONG STRING OF SYMBOLS FROM ANY GIVEN ALPHABET 

< ALGORITHM ) 




C BY CYCLIC SHIFTING WE UNERSTAND THE SHIFTING OF THE RIGHT MOST 

C SYMBOL IN ( GIVEN STRING OF SYMBOLS TO ITS EXTREME LEFT THIS 

C PROGRAM C\SHFT IMPLEMENTS DESIRED NUMBER OF SUCH CYCLIC 


C SHIFTS IN A GIVEN STRING 


DIMENSION ITEMP<4096),ICH(4096) 
OPEN(UNIT=l^ILE«'CYSHFTDAT',STATUS='NEW') 


WRITE<1,79) 

WRITE(*,79) 

79 F0RMAT(10X/GIVE THE NO OF CHARACTERS IN THE INPUT STRING ') 
READ(f,*)NCHAR 
WRITE(i,*)NCHAR 
WRITE!*, 81) 

WRITE(1,81) 

81 FORMAT(10X,'GIVE THE INPUT STRING VIOX/C Press (return) only 
1 after the complete string is given 3') 

READ(*,'(100Ai)')(ITEMPa),I=lMCHAR) 

WRITE<l,92)aTEMP(I),I=l,NCHAR) 

92 FORMAT(/10X,100A1) 

WRITE!*, 82) 

WRITE!i,82) 

82 F0RMAT!10X,'SPECIFY NUMBER OF CYCLIC SHIFTS-') 

READ(*.*)NUM 

WRITE!1,*)NUM 

WRITE!!,*) 

DO 230 IT=llvlUM 


175 KNT=3 
11=1 


12=2 


13=2 


14=2 

IJ1=0 

IC0UNT=0 

F(NCHAR LT 4)G0 to 123 
30 Nl=l 

N2=Ni+KNT 
IJ=IJ1 

DO 20 I=N1,N2,I3 
lF!ITEt^!I+Il) NE IJ)GO TO 15 
IJ=IJ+I4 


28 
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20 CONTINUE 

60 T0(16.i6,31,7,7,8,16,8,8,16),IC0UNT+l 
31 DO 35 IS=1,3 

lFaTEMP(N2).NE.(lS-l))G0 TO 35 
GO TO 15 
35 CONTINUE 

16 DO 10 1=1,12 

IATEMP=ITEMP(N1) 

DO 5 J=N1,N2-1 
ITEMP(J)=ITEMPa+l> 

5 CONTINUE 

ITEMP(N2)=IATEMP 

10 CONTINUE 
IFaC0UNT.EQ.2)G0 TO 190 

1 DO 300 I=llslCHAR 

raTEMP(I).NE.O)GO TO 11 
ICHa)='0' 

GO TO 300 

11 IFaTEMPa).NE.l)GO TO 12 
iCHa)='i' 

GO TO 300 

12 IFaTEMPa).NE.2)G0 TO 13 

ICH(I)='2' 

GO TO 300 

13 ICH(I)=ITEMPa> 

300 CONTINUE 

|/(ffRITE(l,93)IC0UNT,aCH(I),I= 1,NCI-!AR) 
WRITE(*,93)IC0UNT,(ICH(I),I=1,NCHAR) 

93 F0RMAT(2X.I4,5X,65A1> 

FaC0UNT.NE.8)G0 TO 175 

GO TO 230 
15 N1=N1+1 

N2=N2+1 

IF(N1LE.(NCHAR-KNT))G0 TO 28 
123 ICOUNT=ICOUNT+1 

60 TO (100, 110, 120, 130, 140, 150, 160,170, 180), ICOUNT 
100 KNT=2 

11=0 
12=1 

IF(NCHAR.GE.3)G0 TO 30 
GO TO 123 
110 KNT=1 

IJ1=1 

IF(NCHAR.GE.2)G0 TO 30 
GO TO 123 
120 IJ1=0 

13=1 
14=0 

IF(NCHAR.GE.2)GO TO 30 
ICOUNT=ICOUNT+l 
130 1J1=1 

F(NCHAR.GE.2)G0 TO 30 
13=1 
I4=-2 


140 
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IJ1=2 

IF(NCHAR.GE.2)G0 TO 30 
IC0UNT=IC0UNT+1 
150 13=2 

IF(NCHAR.GE.2)G0 TO 30 
IC0UNT=1C0UNT+1 
160 IJ1=1 

13=1 
I4=-l 

IF(NCHAR.GE.2)G0 TO 30 
1C0UNT=1C0UNT+1 
170 KNT=0 

IJ1=2 
60 TO 30 
180 Nl=l 

190 NCHAR=NCHAR+1 

DO 250 1=N1,NCHAR-1 
ITEMP(NCHAR-(I-Nl))=ITEMP(NCHAR-a-Nl)-l) 
250 CONTINUE 

ITEMP(N1)=0 
GO TO 1 

7 ITEMP(N1)=IJ1+1 

8 DO 135 J=N2,NCHAR-1 
ITEMP(J)=ITEMP(J+1) 

135 CONTINUE 

NCHAR=NCHAR-1 
GO TO 1 

230 CONTINUE 

STOP 
END 
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APPENDIX - 2. CA.2] 


LINEAR CONVOLUTION SUBROUTINE 
LISTING OF A SUBROUTINE 
DESIGNED TO COMPUTE LINEAR ODNVOLUTION OF 
NONNEGATI'E INTEGER SEQLENCES OF ARBITRARY LENGTHS 
( ALGORITHM: ) 

THIS PROGRAM LINCOI IMPLENCNTS TIE LINEAR ODNVCLUTION OF ANY TWO 
NON-NEGATIVE INTEGER SEQUENCES OF ARBITRARY LENGTHS f IRELY BY 
MANIPULATING THEIR CORRESPONDING SYMBOLIC REPRESENTATIONS. 

CHARACTER*! ISYM(5)4NL»^(10) 

CHARACTER*10 INFIL 
DIMENSION ITEMP(4096)!CH<4096) 

DATA ISYM/'0','//l'/*'/ V 
INUM(1)=CHAR<224) 

INUM(2)=CHAR(225) 

INUM(3)=CHAR(226) 

lNUM(5)='a' 

lNUM<6)='b' 

INUM(7)=CHAR(235) 

INUM(8)=CHAR(229) 

INIUM<9)=CHAR(23i) 

INUM(iO)=CHAR(254) 

WRITE!*,*)' SPECIFY OUTPUT FILE NAME 
READ(*,'(A)')INFIL 

0PEN(UNIT=1,FILE=INFIL,STATUS='NEW') 

NCHAR=i 

IFLAG=i 

ITEMP(NCHAR)=9 

IATEMP=ISYM(2) 

WRITE!*, 81) 

WRITE!i,8i) 

81 F0RMAT!10X,'GIVE THE LENGTHS OF THE TWO DATA SEQl^NCES'/lOX, 

1 'TO BE CONVOLVED;') 

READ!*,*)N1,N2 

WRITE!1,*)N1,N2 

IDIFF=IABS!N1-N2) 

IMIN=MIN0!N1,N2) 

WRITE!*,82) 

WRITE!1,82) 

82 FORMAT!/ iOX, 'GIVE THE FIRST SEQUENCE-') 

901 DO 800 l=i>ll 

READ!*,*)ICH!I) 

NCHAR=NCHAR+1 
F!ICH!I)J4E.0)G0 TO 805 
ITEMP!NCHAR)=ISYM!1) 
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NCHAR=NCHAR+1 
GO TO 802 

805 DO 801 IT=i,ICH(I) 

ITEMP(NCHAR>=ISYM(3) 

NCHAR=hC;HAR+l 

801 CONTINUE 

802 ITEMP(NCHAR)=IATEMP 

800 CONTINUE 

WRITE<*.2020)IFLAG,aCH(I),I=l,Nl) 

WRITE(1,2020)IFLAG,{ICH(I).1=1,N1) 

2020 F0RMAT</15X, 'SEQUENCE No.',I2,/(/15X,1014)) 

IFLAG=IFLAG+1 

IF(IFLAG.GT.2)GO TO 900 

ITEMP(NCHAR)=3 

IATEMP-=9 

N1=N2 

WRITE(*,83) 

WRITE(1,83) 

83 FORMAT(/10X.'GIVE THE SECOND SEQUENCE-') 

GO TO 901 
900 l^ITEd,*) 

WRITEd,*)' FORMULA ELEMENTARY' 

WRITEd,*)' NUMBER TRANSFORMATIONS' 

^RITEd,*)' ' 

WRITEd,*) 

WRITEd,*)' The pre-convolution string is:' 

NCHARsNCHAR-l 
ITRANS=-1 
GO TO 1 
30 Nl=l 

N2=N1+KNT 
28 !J=IJ1 

DO 20 I=N1,N2,!3 
FaTEHF(I+Il).NE.IJ)GO TO 15 
IJ=IJ+I4 

20 CONTINUE 

IF(ICOUNT,GT,90)GO TO 714 
raCOUNT.GT,7S>GO TO 712 
IFOCOUNT.GT 60)G0 TO 716 
!F<ICOUNT,GT,45)GO TO 710 
FdCOUNT GT.30)G0 TO 705 
F(ICOUNT.GT.i5)GO TO 702 

GO 70(16,480,485,490,16,31,7,7,8,31,16,8,16.500,503,504), 

1 ICOUNT-fl 

702 GO TOf8,8, lie, 16.31,8, 8, 550,553, 555, 560,565,37,570,575),IK0UNT 
705 (» TO{e.5e5, 580.585.590.595,39,525,37,37,37,37,37, 

1 5TO,39),IKOUNT 

710 GO 70(530.532 .535,535.540,545,605,610615,620,625,630635,8,230 
1 ),IKOLWT 

716 GO 70(16,480.485, 490,1661, 7, 7, 8, 31,166d6,500,503)4KOUNT 
712 GO 70(504.8.31,371,391,499,101,102,16,103,501,230,230, 

1 230,230), IKOINT 

714 GO 70(31,509, 37636, 616, 509, 37637676, 230), IKOUNT 

39 IVbI 
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31 

35 


2001 

480 

485 

430 

501 

500 

503 

504 

499 

506 

508 


511 

509 

617 

137 

136 

616 

618 


N2=N2+1 

IF(N2.GT.NCHAR)60 TO 15 

DO 35 15=1.15 

IF(ITEMP(N2).NE.(IS-1))G0 TO 35 

GO TO 15 

CONTINUE 

IF(ICOUNT.LE -65)00 TO 20CK) 

IF(ICOUNT.GT.80)G0 TO 2001 
lKT=ICOUHT-65 

GO TO(16, 230, 230, 230, 16,230,230, 233^,230, 230, 230, 

1 16,230,230),1KT 
IKT=ICOUNT-80 
IFaTEMP(Nl)-NE.9)G0 TO 15 
GO TO 16 

1F<ITEMP(N1+2).NE.9)G0 TO 15 
GO TO 16 

IF(ITEMP(N1+1)-NE.9)G0 to 15 
GO TO 16 

IF(ITEMP(Nl>.NE.ISyM(2))GO TO 15 

N2=N2-t-l 

GO TO 31 

N2=N1 

GO TO 31 

1F(ITEMP<N1)-NE.9)G0 to 15 

N2=N1 

GO TO 8 

IF(ITEMP(N1+2).NE.ISYM(2))G0 TO 15 

F<ITEMP(N1)-NEJSYM{3))60 TO 15 

ITEMP(Nl+2)=4 

GO TO 1 

ITEMP(N1)=3 

ITEMP(N1+1)=1SYM(2) 

N2=N1-1 


IZ=1 

GO TO 538 

ITEMP(N1)=!SYM(2) 

ITEMP(Nl+l)=i 


30 TO 1 

F((N2+l).G'r.NCi-lAR)60 TO 15 
F(ITEMP(N2-<-1)-NE.ISYM(2))G0 TO 15 
F(IC0UNT.£Q -96)G0 to 618 
rnmUNT.EQ.37)G0 TO 618 


DO 136 1=1.2 

DO 137 J=N1>1CHAR-1 

ITEMP(J)=lTE:MP<J+i^ 

CONTINUE 

NCHAR=NCHAR-1 


CONTINUE 

ITEMP(N1)=9 „ 

FGCOUNT £Q.35)ITEMP(N1)=3 


fFaTCMP(Nl+2>.NE:.S><50 TO 15 

GO TO 617 

ITEMP(N1>==3 
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ITEMP<N1+1)=6 
GO TO 1 

525 IF(ITEMP(Nl).KE.9)GO TO 15 

ITEMP(N2)=9 
N2=N2+1 
GO TO 8 

530 IF(ITEMP(N2+1).NE.ISYM(3))G0 TO 15 

N2=N2+1 
GO TO 8 

532 IF(ITEMP(N2+1).NE.ISYM(1))G0 TO 15 

N2=N2+1 
GO TO 8 

535 IF(lTEMP(N2+i).NE.5)G0 TO 15 

FaCOUNTEQ. 48 )GO TO 112 

538 NCHAR=NCHAR+1 
K=N2+1 

DO 125 J=K,NCHAR-1 
ITEMP(NCHAR-(J-K))=ITEhF(NCHAR-(J-K)-l) 

125 CONTINUE 

1F(ICOUNTEQ.86)GO TO 514 
IF(ICOUNT.NE.27)GO TO 529 
ITEMP(N2+1)=5 
GO TO 1 

529 F(IC0UNT.NE.26)G0 TO 537 

542 ITEMP(N2+1)=4 

GO TO 1 

537 FaC0UNT.NE.23)G0 TO 539 

514 IZ=I2+1 

F(IZ.LE.2)G0 TO 538 
FaCOUNT.EQ.86)GO TO 511 
ITEMP(Ni)=ISYM(l) 

ITEMP(N1+1)=1 
GO TO 1 

539 FaCOUNT.NE.24)GO TO 541 

GO TO 542 

541 ITEMP(N2+i)=6 

GO TO 1 

540 F(ITEMP(N2+l).NE.4)GO TO 15 
GO TO 541 

545 FaTEMP(N2+l).NE.7)G0 TO 15 

GO TO 541 

550 13=2 

DO 707 I=Ni,N2,13 

FaTEMPa).NE.ISYM(I-(Ni-l)))GO TO 15 

707 CONTINUE 

ITEMP(N1)=3 
ITEMP(Ni+l)=lSYM(l) 
ITEMP(N1+2)=ISYM(3) 

N2=N1-1 

IZ=1 

GO TO 538 

553 FaTEMP(Nl).NE.ISYM(l))GO TO 15 

FaTEMP(Nl+2).NE.IBYM(l))GO TO 15 
GO TO 638 



555 lF<lTEMP(Ni).NE.ISYM(2))G0 TO 15 
DO 531 1=1,2 
NCHAR=NCHAR+1 
K=N2+1 

DO 126 J=K,NCHAR-1 
ITEMP(NCHAR-(J-K))=ITEMP(NCHAR-(J-K)-1) 

126 CONTINUE 

N2=N2+1 

531 CONTINUE 

1TEMP(N1+1)=1 

lTEMP<Nl+2)=3 

ITEMP(Nl+3)=IS’VTi(2) 

GO TO 1 

560 IF(ITEMP(N1).NE.1SYM(3))G0 TO 15 

IF(1TEMP(N1+2)>’':.ISYM(1))G0 TO 15 

564 N2=N2-1 
GO TO 538 

565 IF(ITEMP(N2).NE.1SYM(3»G0 TO 15 
GO TO 16 

570 IF((N1+1).GT.NCHAR)G0 TO 15 

1F(ITEMP{N1+1).NE.ISYM(1))G0 TO 15 

N1=N1+1 

GO TO 16 

575 IF((N1+2).GT.NCHAR)G0 TO 15 
DO 22 1=1,2 

IF(ITEMP(N1+I).NE.ISYH(1))G0 TO 15 

22 CONTINUE 

IF(ICOUNT.EQ.24)GO TO 638 

GO TO 8 

580 16=9 

581 IF((N1+2).GT.NCHAR)G0 TO 15 

IF(ITEFF(Nl+2).hE:.I6)G0 TO 15 
N2=N2+1 

GO TO 16 

585 16=4 

GO TO 581 

590 16=5 

GO TO 581 

595 16=7 

GO TO 581 

605 IF(ITEMP(N1+2).NE.9)G0 TO 15 

N2=N2+1 

708 IX=3 

DO 718 I=N1,N2 

ITEMP(I)=:IX 

lX=IX+3 

718 CONTINUE 

GO TO 1 

610 IF(ITEMP(N1+2).NE.ISYM(2))G0 TO 15 

611 ITEMP(N1)=3 
ITEMP(N1+1)=7 
GO TO 1 

615 lFaTEMP(Nl+2).NE.5)G0 TO 15 
GO TO 708 



620 IFaTEMP(Nl+2).NE.ISYM(3))G0 TO 15 

ITEMP(N1)=3 
ITEMP(N1+1)=4 
GO TO 1 

625 1F<ITEMP(N1+2).NE.ISYM(1)X30 TO 15 

GO TO 611 

630 F(ITEMP(Nl+3)iCJSYM(l)X50 TO 15 

rrEMRNl)=3 
ITE^r(Nl+l)=ISYM(l) 

GO TO 1 

635 IF(ITEMP(N1+2»<E.6)G0 TO 15 

636 ITEMP(N1>=3 
ITEMP(N1+1)=8 

raCOUNT -EQ .34)ITEMP(N1+1)=ISYM(2) 
GO TO 1 

637 N2=N2+1 
raTE^F(N2)>€:.6)GO TO 15 
ITEMP(N1)=3 
rTEMP(Nl+l)=5 

60 TO 8 

640 ITEMP(N1)=ISYM(3) 

60 TO 1 

112 IFaTEMP(N2+2).NE.4)G0 TO 15 
DO 118 1=1,2 

ITEMP<N2+I)=ITEMP(N2+I)+1 
118 CONTINUE 

60 TO 1 

638 N2=N2-1 
60 TO 538 

116 !TEMP<N1)=ISYM(3) 

ITEMP(N1+1)=8 
60 TO 1 
36 Nl=l 

N2=N1+KNT 
27 IJ=IJ3 

DO 24 1=1,2 
IATEMP=ISYM(IJ) 

IFaTEMP(Nl+I-l).NE.lATEMP)GO TO 115 
IJ=IJ+14 

24 CONTINUE 

GO TO 8 
115 N1=N1+1 

N2=N2+1 

IF(N1.LE.(NCHAR-KNT))G0 TO 27 
GO TO 123 

101 IFaTEMP(Nl).NE.ISYM(2))G0T0 15 
IF(ITEMP(N1+2).NE.ISYM(2)X50T0 15 
ITEMP(Nl+2)=4 

GOTO 8 

102 IF(ITEMP(N1).NE.1SYM(2))G0 TO 15 

ITEMP(Nl+2)=8 

GO TO 1 

103 IF(ITEMP(N1)NE.8)G0 TO 15 

ITEMP(N1+1)=9 
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ITEMP<Nl+2)=8 
GOTO 1 

391 IF«Nl+2).GTMCHAR)GOTO 15 
DO 392 1=1,2 

DO 390 IS=1,10 

IFaTEMP(Nl+I).NE.aS-l))GO TO 390 
GO TO 15 
390 CONTINUE 

392 CONTINUE 
N2=Nl+2 
GO TO 16 

371 IF«N1+2).GT>ICHAR)G0 TO 15 

DO 394 1=1,10 

FaTEhF<Nl+l).NE.a-l))GO TO 394 
GO TO 15 
394 CONTINUE 

IFaTEhP(Nl+2).NE.9)G0 TO 15 

N2=Nl+2 

GO TO 16 

C TO DISPLAY THE CONVOLVED OUTPUT STRING IN DECIMAL FORM: 

2300 IFLAG=1 

ICHaFLAG)=0 
DO 2400 I=1,NCHAR 
IF(ITEhP(I).NE.ISYM(3))G0T0 2500 
ICHaFLAG)=ICH(IFLAG)+l 
GOTO 2400 

2500 IF(ITEMPa)£:Q.ISYM(l»GOTO 2400 
IFLAG=IFLAG+1 
ICHaFLAG)=0 
2400 CONTINUE 

WRITE(*,2010)(ICH<I),I=1,IFLAG) 

WRITE(1,2010KICH(I),I=1,IFLAG) 

2010 F0RMAT(/15X,’THE CONVOLVED OUTPUT STRING IS:’/(/15X,10I4)) 
C*******I******************************************************** 
230 STOP 

END 
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APPENDIX - 3. CA.3] 

ON CONSTRUCTIVE MATHEMATICS 

The adjective constructii'e is used here only in the following sense: the 
presence of this adjective in the term for a concept, the name of a method, the 
name of a branch of mathematics, etc., will signify that the indicated concept, 
method, branch of mathematics, etc., belongs to the constructii^e approach to 
mathematics. 

Markov's constructive approach to mathematics is characterizd by the 
following features: 

(i) In all mathematical theories belonging to this approach, only constructwe 
objects ( i.e., words from alphabets ) figure as objects of study. 

(ii) In the study of constructive objects, one is permitted to make use of the 
idealization of the abstraction of potential realizability (. i.e., the abstraction from 
the real limits of our constructive possibilities, imposed by the limited character 
of our lives in space and time ), but the use of the abstraction of actual infinity 
is completely forbidden. 

(iii) In accordance with the type of objects of study and the abstraction of 
potential realizability as a meaningful basis for the construction of mathematical 
theories one has to take certain constructive interpretaticMi of mathematical 
judgements. 

In what follows, we provide the essential features of the constructive 
interpretation of mathematical judgements. 

Every computing process has to be carried out on the basis of some syii4>olism 
of one's choice. In working with any symbolism, one has to initially provide some 
signs as elementary signs. Elementary signs are also called letters. A list of such 
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nonrepeating letters is called slphsbet. Given an alphabet, ate can construct a new 
alphabet by adding a new letter to the list of letters corresponding to the given 
alphabet. Given a word from an alphabet, one can construct a new word by 
concatenating a letter from the alphabet to the given word. A mathematical object 
(word) is called confutable only when it is computable by an algorithm called 
normsl slgorithm. In other words, a computing process is to be understood as the 
transformation of a word from an alphabet to another from the same alphabet or 
its extension, by means of a normal algorithm, constructed ovt the alphabet. A 
normal algorithm is a totally ordered list of semi-Thue type production formulas. 
These formulas are also known as substitution formulas. 

A normal algorithm can be completely transcribed (cocted) by a word from a 
two-lettered alphabet. Though the method of coding a normal algorithm is unictue as 
per Markov’s transcription theorem, there is no unique way of coding it in a two- 
lettered alphabet. However, an efficient coding of a ncrroal algorithm would be to 
represent it by the word of the shortest length. Tte shortest word that describes 
a normal algorithm is called the complexity of the normal algorithm. So, by 
complexity of a normal algorithm, we actually mean the volune of the program 
specifying the normal algorithm. 

With the idea of describing (normal) algorithms and constructive mathematical 
logic within the framework of a single theory, Markov develoc«d a system of 
languages known as the heirarchical semantic system. Every logico mathematical 
language belonging to this semantic system provides the respective rules of 
writing assertions /propositions about the words from certain basic alphabets and 
the normal algorithms on these alphabets. This system of languages, denoted as Ha- 
( a = 0,1,2, 3, 4,.... (i), 0)1 ), has been built in such a way that the tneaning of the 
formulae of one level is defined in terms of the objects of the previous level. 

The main feature of this heirarchical semantic system is exfx'essed in a 
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theorem of Markov on the completeness of the classical predicate calculus 
relative to the semantics in constructive logic [663. In other words, most of the 
mathematical theories developed within the framework of classical logic have their 
corresponding constructive analogues within this system. This does not assert that 
all the rules of deduction of classical logic are acceptable in constructive 
mathematics. For example, unlike the interpretation given in the classical logic, the 
notion of implication (A o B) is interpreted in a particular language of this system 
as a statement of the assertion that B can be inferred from the premise A by 
means of a semiformal theory of that language. Informally, the implication (AoB) 
expresses the feasibility of a construction p such that if q is an arbitrary 
construction asserting A, then p and q together allow us to look for a 
construction asserting B. 

On the lines of Shanin, it is not necessary in constrtcting various 
mathematical theories within the framework of the constructive approach in 
mathematics, to carry out the proof of each new theorem by applying an algorithm 
to the corresponding formula for its validity. On the other hand, one can prove a 
theorem with the help of the basic rules of logical deduction of a particular 
language in which the corresponding formula is written. 

As regards the notion of constructii^e sets, the term set is mderstood as a 
synonym of the term condition with one parameter, i.e., a constructive logical 
formula in a particular language, with a single free variable. Various operations 
on sets and various propositions about sets are the corresponding constructive 
operations on formulas and propositions about formulas. In this mamer, the basic 
logico mathematical languages allow sufficiently broad possibilities for defining 
sets. 

In constructive mathematics, the notion of a number is understood as the 
normal algorithm that generates it. So, various operations on numbers are the 
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corresponding constructive operations on certain normal algorithms. Choosing a 
constructive analogue of the concept of a real nunber used in classical 
mathematics was one of the major problems in the initial development of 
construtive mathematical anlaysis. Presently a number of definitions of the 
concept of a constructive real number are available, among which the following is 
the definition due to Markov and Shanin. 

Let vto = f 0 I } be an alphabet and 0 be a symbol not in such that J, = 
(0 I 0} is their union. Then the word P<^Q is defined as a constructive real number, 
where P and Q are the transcriptions (words from corresponding to two 

specific normal algorithms, say, U and S&. The normal algorithm XI gives the 
sequence of rational approximating values for the given constructive real number 
and as is a regulator of convergence in itself of XI, i.e., an algorithm computing 
for any natural number n, the subscript, beginning with which the absolute value of 
the difference between terms of the sequence of rational approximating values of 
the given constructive real number is less than 2’*^. 

The concept of a constructive function f of m real variables is an algorithm 
of the type R”’ f R where R is the system of constructive real numbers. 

In this formalism, the constructive differential and integral calculus are very 
much similar to those of the traditional theories. 

Thus, we observe that the entire formulation of the constructive mathematical 
analysis in this manner, is based on the use of normal algorithms in describing 
various essential concepts. 
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